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(54) NETWORK CONTROL SYSTEM, AND CONTROLLER, TARGET AND CONSUMER FOR USE IN 
THE NETWORK CONTROL SYSTEM 



(57) The present invention relates to a networl< con- 
trol system which transmits nr^ss data efficierrtly, 
speedily, and reliably, and has a controller that can eas- 
ily decide what a target has transrriitted, and to a con- 
troller and a target used in this network control system. 

This network control system comprises a controller 
for transmitting a message, a target for perfomning 
processing according to the message, and an initiator 
for establishing a connection for data transmission 

Rg.1 



between the controller and the target, and the system 
perfomns data transmission by using plural protocols. 
Either or both of the controller and the target is/are 
present in a device, and the target is constructed so that 
It receives a message by a first protocol (one of the plu- 
ral protocols) and transmits data onto the connection by 
a second protocol (the other protocol) according to the 
message. 
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Description 

TECHNICAL FIELD 

[0001] The present invention relates to a network 
control system for controlling an audio video computer 
system (hereinafter referred to as "AVC system") com- 
prising devices for handling video data, audio data, 
infonmation data, and the like, and a target, a controller, 
and a consumer used in this network control system. 
Especially, the invention relates to a mass data trans- 
mission/reception system for transmitting information 
for generating, on a screen, a graphk:al user interface 
(hereinafter referred to as "GUI") which supports user 
operation on the devices, by using graphics, texts and 
the like. 

BACKGROUND ART 

[0002] In recent years, a device control system, 
which displays graphics and icons comprising data and 
texts for display indicating the functions of the device on 
the TV screen, and controls the device by selectively 
controlling the graphics or icons with a remote controller 
of the TV, has come along. Further, a network system, 
which connects digital devices such as a digital VTR by 
using IEEE1394-1995, and exchanges video/audio data 
between the devices, has also come along. 
[0003] Hereinafter, such network control system will 
be described briefly. 

[0004] An AVC system utilizing the conventional 
network control system is constructed such that each 
AV device is connected with another AV device by a 
serial bus which can periodically give equal communi- 
cation chance in a bi-directional packet communication 
system, without changing the connection of each AV 
device. As this serial bus, for example, a digital interface 
based on the IEEE 1394 standard is used. 
[0005] Each AV device stores its own data for dis- 
play. The AV device transmits the display data to a con- 
troller in response to a request from the controller 
having a graphic display function, such as a television 
receiver. 

[0006] On receipt of the display data, the controller 
displays the display data. When the controller reads the 
display data, it issues a read command to the AV 
device, and reads desired data as a response from the 
AV device. When the desired data is larger than the 
buffer amount in each AV device, the controller repeat- 
edly issues the read command to obtain the remaining 
data. 

[0007] Further, the controller has the function of 
inquiring about data required for display of the con- 
nected AV device, and the function of controlling the dis- 
play screen on the basis of the display data from the AV 
device. 

[0008] Each AV device has a recording medium 
whk:h stores the display data, and the function of select- 



ing appropriate display data in response to the inquiry 
about the display data from the controller. 
[0009] In the network control system for the AVC 
system so constructed, the display data is stored in 
5 each device (AV device) and the graphics of each 
device (AV device) are displayed on the screen of the 
controller by outputting the display data in response to 
the display request from the controller (television 
receiver). 

10 [0010] Japanese Published Patent Application No. 
Hei. 9-149325 discloses an example of a conventional 
network control system, and Japanese Published Pat- 
ent Application No. Hei. 10-290238 discloses an exam- 
ple of a mass data transmission method. 

15 [0011] In the above- described construction, how- 
ever, the controller must repeatedly issue the command 
according to the buffer amount of the AV device when 
the AV device transmits mass data and, therefore, the 
overhead increases and the transmission efficiency of 

20 the transmission line is degraded. As the result, the data 
transmission time is increased. 

[0012] The present Invention is made to solve the 
above-described problems, and an object of the present 
invention is to provide a network control system that can 

25 transmit mass data such as icon data efficiently, rapidly, 
and reliably, and that can decide what is transmitted 
from the target even when the target spontaneously 
transmits it. Further, another object of the present inven- 
tion is to provide a controller, a target, and a consumer 

30 for the network control system. 

DISCLOSURE OF THE INVENTION 

[0013] In order to solve the above-described prob- 

35 lems, a network control system described in Claim 1 of 
the present invention is a network control system for 
^transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 

40 data, and infonnation data, are connected through a 
transmission line. In this network control system, each 
of the devices includes either or both of at least one 
controller which transmits a message and at least one 
target whteh receives the message and performs 

45 processing according to the message; the network con- 
trol system comprises, at least, the controller, the target, 
and an initiator for establishing a connection for data 
transmission between the controller and the target; the 
plural protocols comprise a first protocol which com- 

50 prises message transmission for transmitting the mes- 
sage and message response which is a response to the 
message transmission, and a second protocol for data 
transmission onto the connection established by the ini- 
tiator; and the target transmits data onto the connection 

55 by the second protocol according to the message 
received by the first protocol. 

[0014] Since the network control system is con- 
structed as described above, an appropriate protocol 
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can be used for mass data such as icon data, resulting 
in rapid data transmission with high transmission effi- 
ciency. 

[001 5] A network control system described in Claim 

2 of the present invention Is a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices includes either or both of at least one 
controller which transmits a message and at least one 
target which receives the message and performs 
processing according to the message; the network con- 
trol system comprises, at least, the controller, the target, 
and an initiator for establishing a connection for data 
transmission between the controller and the target; the 
plural protocols comprise a first protocol which com- 
prises message transmission for transmitting the mes^ 
sage and message response which is a response to the 
message transmission, and a second protocol for data 
transmission onto the connection; the initiator estab- 
lishes, before data transmission, a connection of the 
second protocol between the controller and the target; 
when the controller receives the data from the target, 
the controller makes a data request by the first protocol; 
the target transmits the data onto the connection by the 
second protocol according to the data request; and the 
controller receives the data by the second protocol. 
[0016] Since the network control system is so con- 
structed, when a control code and mass data are trans- 
mitted, an appropriate protocol can be used for each 
transmission, resulting in satisfactory transmission effi; 
ciency. Further, since data transmission and control 
code transmission do not coexist in the same protocol, 
distinction between them is facilitated and, moreover, 
the processes performed by the controller and the tar- 
get are simplified, resulting in increased processing 
speed. 

[001 7] A network control system described in Claim 

3 of the present invention is a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices includes either or both of at least one tar- 
get which receives a message and performs processing 
according to the message, and at least one controller 
which transmits the message and establishes a connec- 
tion for data transmission with the target; the network 
control system comprises, at least, the controller and 
the target; the plural protocols comprise a first protocol 
which comprises message transmission for transmitting 
the message and message response which is a 
response to the message transmission, and a second 
protocol for data transmission onto the connection; the 
controller establishes, before data transmission, a con- 
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nection of the second protocol to the target; when the 
controller receives the data from the target, the control- 
ler makes a data request by the first protocol; the target 
transmrts the data onto the connection by the second 

5 protocol according to the data request; and the control- 
ler receives the data by the second protocol. 
[0018] Since the network control system is so con- 
structed, an appropriate protocol can be used for mass 
data, such as icon data, in the relatively simple con- 

10 structjon, resulting in rapid data transmission with high 
transmission efficiency. 

[001 9] A network control system described in Claim 

4 of the present invention is a network control system for 
transmitting data between devices by using plural proto- 

15 cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices includes- either or both of at feast one 

20 controller which transmits a message and at least one 
target which receives the message and performs 
processing according to the message; the network con- 
trol system comprises, at least, the controller, the target, 
and an initiator for establishing a connection for data 

25 transmission between the controller and the target; the 
plural protocols comprise a first protocol which com- 
prises message transmission for transmitting the mes- 
sage and message response which is a response to the 
message transmission, and a second protocol for data 

30 transmission onto the connection; the initiator estab- 
lishes, before data transmission, a connection by the 
second protocol between the controller and the target; 
the target spontaneously transmits data to the controller 
through the connection by the second protocol; and the 

35 controller receives the data by the second protocol. 
[0020] Since the network control system is so con- 
structed, rapid data transmission with high transmission 
efficiency is achieved. Further, since the target can 
spontaneously transmit data to the controller, the target 

40 can transmit mass data such as icon data by an appro- 
priate protocol, and the controller can easily recognize 
the data transmission. 

[0021] A network control system described in Claim 

5 of the present invention is a network control system for 
45 transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 

50 of the devices includes either or both of at least one tar- 
get whrch receives a message and performs processing 
according to the message, and at least one controller 
which transmits the message and establishes a connec- 
tion for data transmission with the target; the network 

55 control system comprises, at least, the controller and 
the target; the plural protocols comprise a first protocol 
which comprises message transmission for transmitting 
the message and message response whrch is a 
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response to the message transmission, and a second 
protocol for data transmission onto the connection; the 
controller establishes, before data transmission, a con- 
nection of the second protocol to the target; the target 
spontaneously transmits data to the controller through 5 
the connection by the second protocol; and the control- 
ler receives the data by the second protocol. 
[0022] Since the network control system is so con- 
structed, rapid data transmission with high transmission 
efficiency is achieved. Further, since the target can w 
spontaneously transmit data to the controller, the target 
can transmit mass data such as icon data by an appro- 
priate protocol, and the controller can easily recognize 
the data transmission. 

[0023] A network control system described in Claim is 
6 of the present invention is a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 20 
transmission line. In this network control system, each 
of the devices comprises at least one of the following 
units: at least one controller which receives and trans- 
mits a message, at least one target which performs 
processing according to the message and includes at 25 
least one internal function control means, a consumer 
which receives data from the target, and an initiator 
which establishes a connection for data transmission 
between the target and the consumer; the network con- 
trol system comprises, at least, the controller, the target, 30 
the consumer, and the initiator; the plural protocols 
comprise a first protocol which comprises message 
transmission for transmitting the message and message 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 35 
the connection; and when the internal function control 
means performs the data transmission, a connection 
management means in the target connects the output of 
the internal function control means to the connection of 
the second protocol, according to a request of the inter- 40 
nal function control means. 

[0024] Since the network control system is so con- 
structed, an appropriate protocol can be used for mass 
data such as icon data, resulting in rapid data transmis- 
sion with high transmission efficiency. Further, the initia- 45 
tor need not create an internal connection of the target, 
and the target can arbitrarily create its internal connec- 
tion, whereby the target can change the intemal con- 
nection according to the responsivity of each internal 
function control means to perform data transmission. As 50 
the result, the target can be designed with desired per- 
formance. Further, the internal connection of the target 
can be established as desired, plural internal function 
control means can share one connection of the second 
protocol, whereby the resources such as buffers and 55 
plugs which are needed for the second protocol are uti- 
lized effectively. As the result, the construction of the 
target is simplified, and the processing inside the target 



is simplified, resulting in reduced load on the target Fur- 
thermore, since only one connection is needed even 
when controlling the target having plural internal func- 
tion control means, the construction and processing of 
the controller can be simplified. Moreover, even when a 
device having a new function comes on. this target can 
cope with it. and the consumer and the controller can 
easily support this target. 

[0025] A network control system described in Claim 

7 of the present invention is a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In the network control system, each of 
the devices comprises at least one of the following units: 
at least one controller which receives and transmits a 
message, at least one target which performs processing 
according to the message and includes at least one 
internal function control means, a consumer which 
receives data from the target, and an initiator which 
establishes a connection for data transmission between 
the target and the consumer; the network control sys- 
tem comprises, at least, the controller, the target, the 
consumer, and the initiator; the plural protocols com- 
prise a first protocol which comprises message trans- 
mission for transmitting the message and message 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the target transmits data including 
an identifier which specifies the output source of the 
data, onto the connection, according to the second pro- 
tocol. 

[0026] In the network control system so con- 
structed, since the target used in this system transmits 
the data including the identifier of the source of the data 
onto the connection by the second protocol, the con- 
sumer can easily identify the transmitted data by the 
identifier. That is, the consumer can receive desired 
data with reliability by the simple construction, and iden- 
tify the data. Further, also when there are plural pieces 
of target internal function control means of the same 
kind or when the connection of the second protocol is 
shared by plural pieces of target internal function control 
means, the consumer can decide the transmitter with 
reliability by the simple construction. 
[0027] A network control system described in Claim 

8 of the present invention is a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices comprises at least one of the following 
units: at least one controller which receives and trans- 
mits a message, a target which performs processing 
according to the message, a consumer which receives 
data from the target, and an initiator whtoh establishes a 
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connection for data transmission between the target 
and the consumer; the network control system com- 
prises, at least, the controller, the target, the consumer, 
and the initiator; the plural protocols comprise a first 
protocol which comprises message transmission for 5 
transmitting the message and message response which 
is a response to the message transmission, and a sec- 
ond protocol for data transmission onto the connection; 
the controller transmits an identifier which specifies the 
destination in the consumer, to the target, using the first 10 
protocol; and the target transmits the data including the 
identifier which indicates the destination and is received 
by the first protocol, onto the connection, using the sec- 
ond protocol. 

[0028] In the network control system so con- is 
structed, since the data including the identifier indicat- 
ing the destination information transmitted by the first 
protocol is transmitted through the connection of the 
second protocol, the data can be automatically distrib- 
uted to an appropriate internal function control means 20 
even when the identity of the data is not clear. There- 
fore, when there are plural pieces of simitar controller 
internal function control means or when the second pro- 
tocol is shared by plural pieces of controller internal 
function control means, the data can be reliably trans- 25 
mitted to the destination by the simple construction. 
[0029] A network control system described in Claim 
9 of the present invention is a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 30 
diing at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices comprises at least one of the following 
units: at least one controller which receives and trans- 35 
mits a message, at least one target which performs 
processing according to the message and includes at 
least one internal function control means, a consumer 
which receives data from the target, and an initiator 
which establishes a connection for data transmission 40 
between the target and the consumer; the network con- 
trol system comprises, at least, the controller, the target, 
the consumer, and the initiator; the plural protocols 
comprise a first protocol which comprises message 
transmission for transmitting the message and message 45 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; the controller transmits the message by 
the first protocol to a plug through which data is input 
and output to/from a desired internal function control so 
means; and the target executes the process specified 
by the message directed to the plug. 
[0030] In the network control system so con- 
structed, the controller transmits the message by the 
first protocol to the plug through which data is input and ss 
output to/from the internal function control means of the 
target, and the target operates according to this mes- 
sage. Thereby, the relationship between the connection 
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of the second protocol and the message Is defined and, 
further, the data flowing through the connection of the 
second protocol can be associated with the message. 
Further, since the message is transmitted to the plug, 
the target can easily select a controller for handling the 
data transmitted by using this plug, or the target can 
easily permit only control from a specific controller. Fur- 
ther, connection and disconnection of the internal con- 
nection of the target may be performed by the plug. 
Since the controller need not establish the connection 
inside the target, the construction of the network control 
system is simplified. 

[0031] A network control system described in Claim 

10 of the present invention is a network control system 
as described in any of Claims 1 to 9, wherein the mes- 
sage includes a message for confirming the data trans- 
mission by the second protocol. 

[0032] In the network control system so con- 
structed, since conflmnation of data transmission by the > 
second protocol and request for retrar^mission are per- 
formed by the first protocol, the data transmission by the 
second protocol can be reliably performed, whereby the 
reliability of the system can be improved. Further, even 
when normal transmission is not performed due to 
errors not only in the transmission line but also in the 
controller or target, since the data is checked at both of 
the transmitter and receiver as described above, these 
errors can be detected, whereby normal transmission is 
assured. 

[0033] A network control system described in Claim 

1 1 of the present invention is a network control system 
as described in any of Claims 1 to 9. wherein the data 
transmitted by the second protocol includes version 
information, and the version of the data is managed by 
using the version information, 

[0034] In the network control system so con- 
structed, since the data transmitted by the second pro- 
tocol has the version information and the version of the 
data is managed using the version information, the con- 
troller can always check the version information of the 
received data, whereby the controller can always use 
the latest data and, further, the reliability is improved. 
Furthermore, when the controller caches the data, it can 
easily decide whether the information in the function 
chart has been changed or not, according to the state 
change in the target. Therefore, the controller can 
cache the data easily and effectively- 
[0035] A network control system described in Claim 

12 of the present invention is a network control system 
as described in any of Claims 1 to 9, wherein the data 
transmitted by the second protocol is information about 
a graphical user interface which forces the controller to 
make a notification to the user. 

[0036] In the network control system so con- 
structed, since the data to be transmitted by the second 
protocol is the GUI data which instructs the controller to 
make a forced message to the user, when something 
unusual occurs in the target, warning or the like by the 
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GUI can be given to the user. Therefore, the user can 
get the state of the target precisely and speedily. 
[0037] A network control system described in Claim 

13 of the present invention is a network control system 
as described in any of Claims 1 to 9, wherein the data 
transmitted by the second protocol includes attribute 
information of the data. 

[0038] In the network control system so con- 
structed, since the data transmitted by the second pro- 
tocol includes the identifier of the data, the controller 
can correctly recognize the data which is transmitted by 
the target using the second protocol, spontaneously or 
under control of the controller. Further, since the data 
transmitted by the second protocol includes the attribute 
information of the data, the controller can check the 
detail of the data transmitted by the target before check- 
ing the actual data section of the data. Thereby, the con- 
troller can refuse to receive data that cannot be 
displayed by the controller or it can discard such data 
immediately after reception, whereby the resources 
inside the controller such as memories can be utilized 
effectively. 

[0039] A network control system described in Claim 

14 of the present invention is a network control system 
as described in Claim 13, wherein the attribute informa- 
tion includes an identifier, size information, and a data 
section. 

[0040] In the network control system so con- 
structed, since the attribute information includes the 
identifier, the size information, and the data section, the 
object is identified by the identifier, and the breaks of the 
data are defined by the size infomiation, resulting in 
simple and high-speed processing. By making the 
attribute information common in this format, the 
processing for each object is simplified, and the system 
can easily cope with new attribute information. Further, 
a set of plural pieces of attribute information may be 
handled as one attribute information with the same 
effects as mentioned above. 

[0041] A network control system described in Claim 

15 of the present invention is a network control system 
as described in any of Claims 1 to 9, wherein the data 
transmitted by the second protocol is based on an 
object as a unit. 

[0042] In the network control system so con- 
structed, since the data transmitted by the second pro- 
tocol is based on an object as a unit, large-size data can 
be divided into several objects for every function unit or 
display unit, whereby the data becomes resistive to 
errors during transmission and, further, the load on the 
controller or the target can be reduced. 
[0043] A network control system described in Claim 

1 6 of the present invention is a network control system 
as described in Claim 15, wherein the object has the 
same structure as attribute information of the data 
transmitted by the second protocol. 

[0044] In the network control system so con- 
structed, since the object and the attribute information 



have the same structure, the controller can handle both 
of the object and the attribute information in the same 
processing, whereby the processing of the controller is 
reduced, resulting in speedup. Further, the system can 
5 cope with various kinds of objects and attribute informa- 
tion. 

[0045] A network control system described in Claim 
1 7 of the present invention is a network control system 
as described in Claim 15, wherein the object has an 

10 identifier, size information, arid a data section. 

[0046] In the network control system so con- 
structed, since the object includes the identifier, the size 
information, and the data section, the object is identified 
by the identifier, and the breaks of data are defined by 

75 the size information, resulting in simple and high-speed 
processing. Further, by making the data common in this 
format, processing for each object is simplified, and the 
system can easily deal with a new object. 
[0047] A network control system described In Claim 

20 1 8 of the present invention is a network control system 
as described in Claim 15, wherein the object has 
attribute information in the data section. 
[0048] In the network control system so con- 
structed, since the object has the attribute information in 

25 the data section, the attribute information can be easily 
detected, whereby processing of the attribute informa- 
tion is simplified. 

[0049] A controller described in Claim 19 of the 
present invention is a controller used a network control 
30 system for transmitting data between devices by using 
plural protocols, in a network in which at least two 
devices for handling at least one kind of data among 
video data, audio data, and information data, are con- 
nected through a transmission line. In the network con- 
35 trol system, each of the devices includes either or both 
of at least one controller which transmits a message 
and at least one target which receives the message and 
performs processing according to the message; the net- 
work control system comprises, at least, the controller 
40 and the target; a connection for data transmission 
between the controller and the target is established by 
an initiator or the controller; the plural protocols com- 
prise a first protocol which comprises message trans- 
mission for transmitting the message and message 
45 response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the controller supports the plural 
protocols, transmits the message by the first protocol, 
and receives the data from the connection by the see- 
so ond protocol. 

[0050] Therefore, a controller capable of transmit- 
ting mass data rapidly and with high transmission effi- 
ciency is provided. 

[0051] A controller described in Claim 20 of the 
55 present invention is a controller used in a network con- 
trol system for transmitting data between devices by 
using plural protocols, in a network in which at least two 
devrces for handling at least one kind of data among 
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video data, audio data, and Information data, are con- 
nected through a transmission line. In this network con- 
trol system, each of the devices includes either or both 
of at least one controller which transmits a message 
and at least one target which receives the message and 5 
performs processing according to the message; the net* 
work control system comprises, at least, the controller 
and the target; a connection for data transmission 
between the controller and the target is established by 
an initiator or the controller; the plural protocols com- 10 
prise a first protocol which comprises message trans- 
mission for transmitting the message and message 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the controller supports the plural 15 
protocols, makes a data request by the first protocol, 
and receives the data transmitted according to the data 
request, from the connection, by the second protocol. 
[0052] Since the controller is so constructed, .when 
transmitting a control code and mass data, an appropri- 20 
ate protocol can be used as desired for each transmis- 
sion, whereby a controller minimizing waste and 
providing satisfactory transmission efficiency is 
obtained. 

[0053] A controller described In Claim 21 of the 25 
present invention is a controller used in a network con- 
trol system for transmitting data between devices by 
using plural protocols, in a network in which at least two 
devices for handling at least one kind of data among 
video data, audio data, and information data, are con- 30 
nected through a transmission line. In this network con- 
trol system, each of the devices includes either or both 
of at least one controller which transmits a message 
and at least one target which receives the message and 
performs processing according to the message; the net- 35 
work control system comprises, at least, the controller 
and the target; a connection for data transmission 
between the controller and the target is established by 
an Initiator or the controller; the plural protocols com- 
prise a first protocol which comprises message trans- 40 
mission for transmitting the message and message 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the controller supports the plural 
protocols, establishes the connection to the target 45 
before data transmission, makes a data request by the 
first protocol when receiving data, and receives the data 
transmitted according to the data request, from the con- 
nection, by the second protocol. 

[0054] Since the controller is so constructed, an so 
appropriate protocol can be used for mass data such as 
icon data, resulting in a controller capable of performing 
rapid data transmission with high transmission effi- 
ciency. 

[0055] A controller described in Claim 22 of the 55 
present invention is a controller used in a network con- 
trol system for transmitting data between devk:es by 
using plural protocols, in a network in whteh at least two 



devices for handling at feast one kind of data among 
video data, audio data, and information data, are con- 
nected through a transmission line. In this network con- 
trol system, each of the devices includes either or both 
of at least one controller which transmits a message 
and at least one target which receives the message and 
performs processing according to the message; the net- 
work control system comprises, at least, the controller 
and the target; a connection for data transmission 
between the controller and the target is established by 
an initiator or the controller; the plural protocols com- 
prise a first protocol which comprises message trans- 
mission for transmitting the message and message 
response whk:h is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the controller supports the plural 
protocols, and receives the data which is transmitted 
onto the connection spontaneously by the target using 

the second protocol. 

[0056] Therefore, a controller capable of performing 
rapid data transmission with high transmission effi- 
ciency is obtained. 

[0057] A controller described in Claim 23 of the 
present invention is a controller used in a network con- 
trol system for transmitting data between devices by 
using plural protocols, in a network in which at least two 
devices for handling at least one kind of data among 
video data, audio data, and information data, are con- 
nected through a transmission line. In this network con- 
trol system, each of the devices includes either or both 
of at least one controller which transmits a message 
and at least one target which receives the message and 
perfomis processing according to the message; the net- 
work control system comprises, at least, the controller 
and the target; a connection for data transmission 
between the controller and the target is established by 
an initiator or the controller; the plural protocols com- 
prise a first protocol which comprises message trans- 
mission for transmitting the message and message 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the controller supports the plural 
protocols, establishes the connection of the second pro- 
tocol to the target before data transmission, and 
receives the data which is transmitted onto the connec- 
tion spontaneously by the target using the second pro- 
tocol. 

[0058] Therefore, a controller capable of performing 
rapid data transmission with high transmission effi- 
ciency is obtained. 

[0059] A controller described in Claim 24 of the 
present invention is a controller used in a network con- 
trol system for transmitting data between devices by 
using plural protocols, in a network in which at least two 
devices for handling at least one kind of data among 
video data, audio data, and information data, are con- 
nected through a transmission line. In this network con- 
trol system, each of the devices comprises at least one 



7 



BNSOOaD: <EP 1071255A1 I > 



BNS oaae 7 



13 



EP 1 071 255 A1 



14 



of the following units: at least one controller which 
receives and transmits a message, a target which per- 
forms processing according to the message, a con- 
sumer which receives data from the target, and an 
initiator which establishes a connection for data trans- 
mission between the target and the consumer; the plu- 
ral protocols comprise a first protocol which comprises 
message transmission for transmitting the message and 
message response which is a response to the message 
transmission, and a second protocol for data transmis- 
sion onto the connection; the network control system 
comprises, at least, the target which transmits data 
including an identifier indicating the destination and 
received by the first protocol, onto the connection, using 
the second protocol, the controller, the consumer, and 
the initiator; and the controller transmits the identifier 
indicating the destination in the consumer, to the target, 
using the first protocol. 

[0060] When the controller so constructed is used 
in the network control system, the data can be automat- 
ically distributed to an appropriate internal function con- 
trol means even when the identity of the data is not 
clear. Therefore, when there are plural pieces of similar 
controller internal function control means or when the 
second protocol is shared by plural pieces of controller 
internal function control means, the data can be reliably 
transmitted to the destination by the simple construc- 
tion. 

[0061] A controller described in Claim 25 of the 
present invention is a controller used in a network con- 
trol system for transmitting data between devices by 
using plural protocols, in a network in which at least two 
devices for handling at least one kind of data among 
video data, audio data, and information data, are con- 
nected through a transmission line. In this network con- 
trol system, each of the devices comprises at least one 
of the following units: at least one controller which 
receives and transmits a message, at least one target 
which performs processing according to the message 
and includes at least one internal function control 
means, a consumer which receives data from the tar- 
get, and an initiator which establishes a connection for 
data transmission between the target and the con- 
sumer; the plural protocols comprise a first protocol 
which comprises message transmission for transmitting 
the message and message response which is a 
response to the message transmission, and a second 
protocol for data transmission onto the connection; the 
network control system comprises, at least, the target 
which executes the process specified by the message 
directed to a plug through which data is input and output 
to/from a desired internal function control means, the 
controller, the consumer, and the initiator; and the con- 
troller transmits the message to the plug by the first pro- 
tocol. 

[0062] When the controller so constructed is used 
in the network control system, the relationship between 
the connection of the second protocol and the message 



is defined and. further, the data flowing through the con- 
nection of the second protocol can be associated with 
the message. Further, since the message is transmitted 
to the plug, the target can easily select a controller for 

5- handling the data transmitted by using this plug, or the 
target can easily permit only control from a specific con- 
troller. Further, connection and disconnection of the 
internal connection of the target may be performed by 
the plug. Since the controller need not establish the 

10 connection inside the target, the construction of the net- 
work control system is simplified. 

[0063] A target described in Claim 26 of the present 
invention is a target used in a network control system for 
transmitting data between devices by using plural proto- 

75 cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices includes either or both of at least one 

20 controller which transmits a message and at least one 
target which receives the message and performs 
processing according to the message; the network con- 
trol system comprises, at least, the controller and the 
target; a connection for data transmission between the 

25 controller and the target is established by an initiator or 
the controller; the plural protocols comprise a first proto- 
col which comprises message transmission for trans- 
mitting the message and message response which is a 
response to the message transmission, and a second 

30 protocol for data transmission onto the connection; and 
the target supports the plural protocols, and transmits 
the data onto the connection by the second protocol 
according to the message received by the first protocol. 
[0064] Therefore, a target capable of transmitting 

35 mass data rapidly and with high transmission efficiency 
is obtained. 

[0065] A target described in Claim 27 of the present 
invention is a target used in a network control system for 
transmitting data between devices by using plural proto- 

40 cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices includes either or both of at least one 

45 controller which transmits a message and at least one 
target which receives the message and performs 
processing according to the message; the network con- 
trol system comprises, at least, the controller and the 
target; a connection for data transmission between the 

50 controller and the target is established by an initiator or 
the controller; the plural protocols comprise a first proto- 
col which comprises message transmission for trans- 
mitting the message and message response which is a 
response to the message transmission, and a second 

55 protocol for data transmission onto the connection; and 
the target supports the plural protocols, and transmits 
the data onto the connection by the second protocol, 
according to a data request from the controller by the 



8 



BNSDOCID: <EP 1071255A1 I > 



BNS oaoe 8 



15 



EP 1 071 255 A1 



16 



first protocol. 

[0066] Since the target is so constructed, when a 
control code and mass data are transmitted, an appro- 
priate protocol can be used as desired for each trans- 
mission, resulting in a target minimizing waste and 
providing satisfactory transmission efficiency. 
[0067] A target described in Claim 28 of the present 
invention a target used in a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices includes either or both of at least one 
controller which transmits a message and at least one 
target which receives the message and performs 
processing according to the message; the network con- 
trol system comprises, at least, the controller and the 
^.target; a connection for data transmission between the 
controller and the target is established by an initiator or 
the controller; the plural protocols comprise a first proto- 
col which comprises message transmission for trans- 
mitting the message and message response which is a 
response to the message transmission, and a second 
protocol for data transmission onto the connection; and 
the target has the plural protocols, and spontaneously 
transmits the data onto the connection by the second 
protocol. 

[0068] Therefore, a target capable of performing 
rapid data transmission with high transmission effi- 
ciency is obtained. 

[0069] A target described in Claim 29 of the present 
invention is a target used in a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices comprises at least one of the following 
units: at least one controller which receives and trans- 
mits a message, at least one target which performs 
processing according to the message and includes at 
least one internal function control means, a consumer 
which receives data from the target, and an initiator 
which establishes a connection for data transmission 
between the target and the consumer; the network con- 
trol system comprises, at least, the controller, the target, 
the consumer, and the initiator; the plural protocols 
comprise a first protocol which comprises message 
transmission for transmitting the message and message 
response which is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and, in the target, when the internal 
function control means performs the data transmission, 
a connection management means in the target con- 
nects the output of the internal function control means 
to the connection of the second protocol, according to a 
request from the internal function control means. 



[0070] Since the target is so constructed, the initia- 
tor need not create an internal connection of the target, 
and the target can arbitrarily create its internal connec- 
tion, whereby the target can change the internal con- 

5 nection according to the responsivity of each internal 
function control means to perform data transmission. As 
the result, the target can be designed with desired per- 
formance. Further, the internal connection of the target 
can be established as desired, plural internal function 

10 control means can share one connection of the second 
protocol, whereby the resources such as buffers and 
plugs which are needed for the second protocol are uti- 
lized effectively. As the result, the construction of the 
target is simplified, and the processing inside the target 

15 is simplified, resulting in reduced load on the target. Fur- 
thermore, since only one connection is needed even 
when controlling the target having plural internal func- 
tion control means, the construction and processing of 
the controller can be simplified. Moreover, even when a 

20 device having a new function comes on, this target can 
cope with it. and the consumer and the controller can 
easily support this target. 

[0071] A target described in Claim 30 of the present 
invention is a target used in a network control system for 

25 transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In the network control system, each of 

30 the devices comprises at least one of the following units: 
at least one controller which receives and transmits a 
message, at least one target which perfonms processing 
according to the message and includes at least one 
internal function control means, a consumer which 

35 receives data from the target, and an initiator which 
establishes a connection for data transmission between 
the target and the consumer; the network control sys- 
tem comprises, at least, the controller, the target, the 
consumer, and the initiator; the plural protocols com- 

40 prise a first protocol which comprises message trans- 
mission for transmitting the message and message 
response whbh is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; and the target transmits data including 

45 an Identifier which specifies the output source of the 
data, onto the connection, by the second protocol. 
[0072] When the target so constructed is used in 
the network control system, the consumer as a compo- 
nent of this network control system can easily identify 

50 the data transmitted. That is, the consumer can reliably 
receive desired data by relatively simple construction, 
and Identify the data. Further, when there are plural 
pieces of target internal function control means of the 
same kind or when the connection of the second proto- 

55 col is shared t>y plural pieces of target internal function 
control means, the transmitter can be decided reliably 
by simple construction. 

[0073] A target described in Claim 31 of the present 
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invention is a target used in a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and- information data, are connected through a 
transmission line. In this network control system, each 
of the devices comprises at least one of the following 
units: at least one controller which receives and trans- 
mits a message, a target which performs processing 
according to the message, a consumer which receives 
data from the target, and an initiator which establishes a 
connection for data transmission between the target 
and the consumer; the plural protocols comprise a first 
protocol which comprises message transmission for 
transmitting the message and message response which 
is a response to the message transmission, and a sec- 
ond protocol for data transmission onto the connection; 
the network control system comprises, at least, the con- 
troller whteh transmits an identifier indicating the desti- 
nation in the consumer by the first protocol, the target, 
the consumer, and the initiator; and the target transmits 
data including the identifier indicating the destination 
and received by the first protocol, onto the connection, 
by the second protocol. 

[0074] When the target so constructed is used in 
the network control system, the data can be automati- 
cally distributed to an appropriate internal function con- 
trol means even when the identity of the data is not 
clear. Therefore, when there are plural pieces of similar 
controller internal function control means or when the 
second protocol is shared by plural pieces of controller 
internal function control means, the data can be reliably 
transmitted to the destination by the simple construc- 
tion. 

[0075] A target described in Claim 32 of the present 
invention is a target used in a network control system for 
transmitting data between devices by using plural proto- 
cols, in a network in which at least two devices for han- 
dling at least one kind of data among video data, audio 
data, and information data, are connected through a 
transmission line. In this network control system, each 
of the devices comprises at least one of the following 
units: at least one controller which receives and trans- 
mits a message, at least one target which performs 
processing according to the message and includes at 
least one internal function control means, a consumer 
which receives data from the target, and an initiator 
which establishes a connection for data transmission 
between the target and the consumer; the plural proto- 
cols comprise a first protocol which comprises message 
transmission for transmitting the message and message 
response whteh is a response to the message transmis- 
sion, and a second protocol for data transmission onto 
the connection; the network control system comprises, 
at least, the controller which transmits the message by 
the first protocol to a plug through which data is input 
and output to/from a desired internal function control 
means, the target, the consumer, and the initiator; and 



the target executes the process specified by the mes- 
sage directed to the plug. 

[0076] When the target so constructed is used in 
the network control system, the relationship between 

5 the connection of the second protocol and the message 
is defined and. further, the data flowing through the con- 
nection of the second protocol can be associated with 
the message. Further, since the message is transmitted 
to the plug, the target can easily select a controller for 

10 handling the data transmitted by using this plug, or the 
target can easily permit only control from a specific con- 
troller. Further, connection and disconnection of the 
internal connection of the target may be performed by 
the plug. Since the controller need not establish the 

15 connection inside the target, the construction of the net- 
work control system is simplified. 
[0077] A consumer described in Claim 33 of the 
present invention Is a consumer used in a network con- 

trol system for transmitting data between devices by 

20 using plural protocols, in a network in which at least two 
devices for handling at least one kind of data among 
video data, audio data, and information data, are con- 
nected through a transmission line. In the network con- 
trol system, each of the devices comprises at least one 

25 of the following units: the consumer, at least one con- 
troller which receives and transmits a message, a target 
which performs processing according to the message, 
and an initiator which establishes a connection for data 
transmission between the target and the consumer; the 

30 network control system comprises, at least, the control- 
ler, the target, the consumer, and the initiator; the plural 
protocols comprise a first protocol which comprises 
message transmission for transmitting the message and 
message response which is a response to the message 

35 transmission, and a second protocol for data transmis- 
sion onto the connection; and the consumer receives 
data including an identifier identifying the destination in 
the consumer, which data is transmitted by the target 
onto the connection by the second protocol and 

40 received from the controller by the first protocol. 

[0078] Since the consumer is so constructed, the 
consumer which has received the data can easily and 
rapidly decide an internal function control means inside 
the consumer to which the received data is to be trans- 

45 mitted, whereby the data can be automatically transmit- 
ted to an appropriate internal function control means 
even when the identity of the data is not clear. There- 
fore, when there are plural pieces of similar controller 
internal function control means or when the second pro- 

50 tocol is shared by plural pieces of controller internal 
function control means, the data can be reliably trans- 
mitted to the destination by the simple construction. 

BRIEF DESCRIPTION OF THE DRAWINGS 

55 

[0079] 

Figure 1 is a system configuration diagram illustrat- 
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ing an example of a network control system accord- 
ing to a first embodiment of the present invention. 
Figure 2 is a block diagram illustrating a target in 
the network control system according to the first 
embodiment of the present invention. s 
Figure 3 is a block diagram illustrating a controller in 
the network control system according to the first 
embodiment of the present invention. 
Figure 4(a) is a system configuration diagram in the 
case where an initiator according to the first embod- io 
iment of the present invention is present, and figure 
4(b) is a system configuration diagram in the case 
where the initiator according to the first embodi- 
ment of the present invention is absent. 
Figure 5 is a diagram illustrating the configuration of is 
a function chart according to the first embodiment 
of the present invention. 

Figure 6 is a diagram for explaining a protocol 
according to the first embodiment of the present 
invention. 20 
Figure 7 is a flow chart illustrating the operation of 
the controller according to the first embodiment of 
the present invention. 

Figure 8 is a flow chart illustrating the operation of 
the target according to the first embodiment of the 25 
present invention. 

Figure 9 is a diagram for explaining the protocol 
when transmission is confirmed, according to the 
first embodiment of the present invention. 
Figure 10(a) is a diagram illustrating the configura- 30 
tion of display elements according to the first 
embodiment of the present invention, and figure 
10(b) is a diagram illustrating the configuration of 
attribute information according to the first embodi- 
ment of the present invention. 35 
Figure 1 1 is a diagram illustrating the configuration 
of display data according to the first embodiment of 
the present invention. 

Figure 12 is a diagram illustrating an example of a 
function chart according to the first embodiment of 40 
the present invention. 

Figure 13 is a diagram illustrating an example of 
display on the screen of the controller according to 
the first embodiment of the present invention. 
Figure 14 is a diagram for explaining the example of 45 
the function chart according to the first embodiment 
of the present Invention. 

Figure 15 is a system configuration diagram illus- 
trating an example of a network control system 
according to a second embodiment of the present so 
invention. 

Figure 16 is a block diagram illustrating a target in 
the network control system according to the second 
embodiment of the present invention. 
Figure 1 7 is a block diagram illustrating a controller 55 
in the network control system according to the sec- 
ond embodiment of the present invention. 
Figure 18(a) is a system configuration diagram in 



the case where an Initiator according to the second 
embodiment of the invention is present, figure 18(b) 
is a system configuration diagram in the case 
where the initiator according to the second embod- 
iment of the invention is absent, and figure 18(c) is 
a system configuration diagram including a con- 
sumer according to the second embodiment of the 
present invention. 

Rgure 1 9 is a diagram illustrating the relationship 
between a controller creating a connection, and a 
target, according to the second embodiment of the 
present invention. 

Figure 20 is a diagram illustrating the relationship 
between a controller creating a connection, and a 
target having a plurality of internal function control 
means, according to the second embodiment of the 
present invention. 

Figure 21 is a diagram illustrating the relationship 
between controllers creating connections,, and a 
target having a plurality of internal function control 

means. 

Rgure 22 is a diagram for explaining a protocol 
according to the second embodiment of the present 
invention. 

Rgure 23 is a flowchart illustrating the operation of 
the controller according to the second embodiment 
of the present invention. 

Rgure 24 is a flowchart illustrating the operation of 
the target according to the second embodiment of 
the present invention. 

BEST MODE TO EXECUTE THE INVENTION 

[0080] Hereinafter, embodiments of network control 
systems according to the present invention will be 
described with reference to the drawings. These 
embodiments described hereinafter are merely exam- 
ples, and the present invention is not restricted thereto. 
[0081] As a network construction of an AVC system 
utilizing a network control system described hereinafter, 
for example, a construction comprising 
video/audio/information devices as shown in figure 1 is 
considered. A "target" described in this specification is 
an object to be controlled, and a "controller* is a device 
for controlling the object to be controlled. Further, a 
"consumer" Is a device for receiving data from the tar- 
get, and an "initiator' is a devk:e for creating a connec- 
tion based on of a second protocol between the target 
and the consumer. Further, in this specification, 
video/audio/information devices are called "device", and 
these devices include not only existing 
video/audio/information devices such as printers and 
minidisks but also devices relating to these fields which 
will be developed in the future. An arbitrary combination 
of a target, a controller, a consumer, and an initiator may 
coexist in one device, or only one of them may exist in 
one devtee. Further, one device may include plural con- 
trollers, plural targets, plural consumers, and plural in'iti- 
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ators. 

[0082] Further, each device corresponds to one 
node on the transmission line, and it may be con- 
structed such that plural nodes are included in one 
body. 

[0083] When one device includes plural targets, or 
when one device has different functions, or when one 
device has plural targets, controllers, consumers, or ini- 
tiators, the respective constituents, i.e., targets, control- 
lers, consumers, or initiators, described hereinafter may 
be shared with another function or means. 
[0084] "Plugs" in the following description indicate 
openings for inputting and outputting data, and these 
plugs are logical plugs. For example, these plugs pos- 
sess respective plug numbers so that they are distin- 
guished from each other with the plug numbers. 
Further, these plug numbers may be constructed by 
one-to-one correspondence with lO (Input/Output) 
addresses or the like.*- 

(Embodiment 1) 

[0085] Initially, a description will be given of a net- 
work of an AVC system utilizing a network control sys- 
tem according to the present invention, with reference to 
the drawings. 

[0086] Figure 1 is a diagram illustrating an example 
of a system construction according to a first embodi- 
ment of the invention. In this first embodiment, 21 
denotes a TV, 22 denotes a remote controller of the TV, 
23 denotes a personal computer (hereinafter, referred 
to as "PC"), 31 denotes a digital video disk (hereinafter 
referred to as "DVD") capable of recording and play- 
back, 32 denotes a digital video system (hereinafter 
referred to as "DV system") digital VTR (hereinafter 
referred to as "DVC"), 33 denotes a VHS system digital 
VTR (hereinafter refen-ed to as "DVHS"), 34 denotes a 
DV system digital movie (hereinafter referred to as "DVC 
movie"), and 35 denotes a set-top box (hereinafter 
referred to as "STB") for CS digital broadcasting or the 
like. These devices are connected through a transmis- 
sion line 1 to constitute an AVC system as shown in fig- 
ure 1. 

[0087] . The TV 21 is a device comprising a control- 
ler and a target (in this case, a ground wave tuner and a 
video monitor), and the user gives an instruction to a 
display/function selection means 1 4 by using the remote 
controller 22. 

[0088] The PC 23 is a device comprising a control- 
ler and a target (in this case, a modem interfacing with a 
telephone line, and a video monitor), and the user gives 
an instruction to a display/function selection means 14 
by using a key board or a mouse. 
[0089] Each of the TV 21 and the PC 23 is defined 
as a device in which the target and the controller are 
united. Amongst the target functions in the device, the 
functions accessible from another device are written in 
a function chart 8 described later, but the device does 



not enter its own functions in a function data base 13 of 
the controller in the device. The reason will be 
described later in the description for the controller. 
[0090] The TV 21 or the PC 23 may be defined as a 

5 device comprising a target and a controller and having a 
function chart 8 for each target in the device. In this 
case, each function chart 8 of the device may be 
entered in a function data base 1 3 of the controller in the 
device which will be described later. 

10 [0091] The DVD 31 and the DVC movie 34 are tar- 
gets capable of recording and playing AV data. Further, 
the DVC 32 and the DVHS 33 are device each compris- 
ing a target capable of recording and playing AV data, 
and a target having a digital broadcasting tuner func- 

15 tion. The STB 35 is a target having a tuner function for 
receiving CS digital broadcasting. 

[0092] Although the DVD 31 , the DVC 32. the DVHS 
33. the DVC movie 34. and the STB 35 are described as 
targets, each of them -may be a device comprising a 

20 controller and a target as long as it realizes an environ- 
ment for controlling another target with a liquid crystal 
panel or the like regardless of the size of the device, and 
it permits the user to select the function of another tar- 
get with a touch panel or a remote controller. 

25 [0093] Further, each of the above-described 
devices constituting the AVC system may be con- 
structed such that it has the function as a controller and 
includes a remote controller, only the display and audio 
are shown on a monitor by analog connection or the 

30 like, and the user controls the device with the remote 
controller while watching the monitor screen. In this 
case, the device may be a device including a controller 
and a target. 

[0094] Hereinafter, a description will be given of a 
. 35 target used for the network control system for the AVC 
system so constructed, with reference to the drawings. 
[0095] Figure 2 is a block diagram of a target 
included in the network control system according to the 
first embodiment Hereinafter, constituents of the target 
40 and the operations of the respective constituents will be 
described. 

[0096] In figure 2, 1 denotes a transmission line, 2 
denotes a packet transmission/reception means, 3 
denotes a synchronous data transmission/reception 

45 means, 4 denotes a target signal processing means. 5 
denotes an asynchronous data transmission/reception 
means, 6 denotes a first protocol processing means, 7 
denotes device construction information. 6 denotes a 
function chart, 9 denotes an inside-of-device control 

50 means. 15 denotes a read only memory (ROM) in which 
a part of the function chart 8 is placed, 16 denotes a 
random access memory (RAM) in which a part of the 
function chart 8 is placed, 17 denotes a function infor- 
mation management means, and 1 8 denotes a second 

55 protocol transmission means. 

[0097] The transmission line 1 is, for example, a 
serial bus (1 394 bus) defined by the IEEE1 394 standard 
(IEEE1394-1995 and upper standard having compatibil- 
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ity with this). The transmission line 1 is not necessarily 
the 1394 bus, and it may be an ATM. the Ethernet, or an 
infrared transmission line. 

[0098] Next, the packet transmission/reception 
means 2 physically and electrically interfaces with the 
transmission line 1, and performs arbitration of the right 
to use the bus, cycle control for synchronous transmis- 
sion, and the like. Further, the packet transmis- 
sion/reception means 2 selects a packet on the 
transmission line 1 according to its destination, and 
transmits the packet onto the transmission line 1 . 
[0099] The synchronous data transmission/recep- 
tion means 3 performs, when transmitting data, man- 
agement of the transmission rate (division of data), and 
addition of headers. For example, when using the AV 
protocol (IEC61883) standard of the 1394 bus. the syn- 
chronous data transmission/reception 3 performs addi- 
tion of CIP (Common Isochronous Packet) headers. 
When receiving data, the synchronous, data transmis- 
sion/reception 3 performs rearrangement of received 
packets in correct order, and removal of headers from 
the packets. 

[0100] The target signal processing means 4 
receives synchronous data from the synchronous data 
transmission/reception means 3, and performs signal 
processing according to the target. For example, when 
the target is a recording^playback devk:e such as a 
DVC, It records the synchronous data on a recording 
medium such as a magnetic tape. Further, the target 
signal processing means 4 takes the synchronous data 
from a recording medium, a broadcast wave or the like, 
and transmits it to the synchronous data transmis- 
sion/reception means 3. 

[0101] The asynchronous data transmission/recep- 
tion means 5 performs transaction of the asynchronous 
data according to the transmission line 1 . For example, 
when the transmission line 1 is the 1394 bus, the asyn- 
chronous data transmission/reception means 5 per- 
forms read transaction, write transaction, locked 
transaction or the like. The asynchronous data trans- 
mission/reception means 5 may be constituted by soft- 
ware. The asynchronous data transmission/reception 
means 5 may transmit or receive an acknowledge signal 
to a request (e.g., read request) or a response (e.g., 
read response), amongst these transactions. However, 
this acknowledge signal is omitted in the description of 
the invention. 

[0102] The first protocol processing means 6 proc- 
esses the asynchronous data (message) supplied from 
the asynchronous data transmission/reception means 
5, and transmits it to an appropriate constituent of the 
target, and responds to the controller according to the 
first protocol. 

[0103] When using, as the first protocol, the AV/C 
command (AudioA/ideo Control Digital Interface Com- 
mand Set) whrch is discussed in the FCP and the 1394 
TA (1394 Trade Association) of the AV protocol 
(1EC61883) standard, the first protocol processing 



means 6 operates so as to convert the received mes- 
sage to a message available in the target, and respond 
to the received message according to the first protocol. 
For example, when the received message is a request 

5 for data, the first protocol processing means 6 judges its 
effectiveness, and when it is effective, the means 6 
acknowledges the receipt of the message to the control- 
ler and, simultaneously, instructs the inside-of-devk:e 
control means 9 to execute the function corresponding 

10 to the request of data. 

[0104] Further, the first protocol processing means 
6 can transmit asynchronous data (message) and, at 
this time, the means 6 converts the message available 
in the target to the message to be used in the first pro- 

15 tocol, and waits for a response to the message to under- 
stand it. In this case, when the controller requests to 
read the devk:e configuration Information 7. the asyn- 
chronous data transmission/reception means 5 trans- 

V mits the Information written In the devk:e construction 

20 information 7 to the controller according to the received 
request. 

[0105] The asynchronous data transmission/recep- 
tion means 5 and the first protocol processing means 6 
may be constructed as one means. 

25 [0106] The devtee configuration information 7 indi- 
cates the information about the configuration of the 
device. As for the method of describing the information 
7, for example, it may be described according to the rule 
indicated by the configuration ROM of the CSR (Com- 

30 mand and Status Registers) architecture indicated by 
the ISO/IEC13213:1994 standard. When using the 
1394 bus. the device configuration information 7 
includes a unit directory including information about the 
bus corresponding to the device as to whether the bus 

35 manager or isochronous operation is supported or not 
and information as to whether the AV protocol is sup- 
ported or not, and an unique ID that is an identifier of 
this device. Further, information about the target is also 
described in the device configuration information 7. 

40 [0107] The target information is, for example, the 
kind of protocol or command supported by the target, 
the target type obtained by coding the type of the target, 
the version information of the target, etc. 
[0108] The target type is infonmation by which the 

45 outline of the function of the target is known, such as a 
VTR or a STB. For example, the target type may be indi- 
cated by a code or text string that Is indteated by the 
subunit type of the AV/C digital interface command set 
(AV/C-CTS) discussed by the 1394 TA. 

50 [0109] The target information may include informa- 
tion indicating the feature of the function chart 8 
described later, in addition to those mentioned above, 
and the support level, size, and the like of the function 
chart 8 may be described as unique information. 

55 Thereby, before the controller reads the Information of 
the function chart 8. the controller itself can decide 
whether the function chart 8 is in the supportable level 
or not or how large memory space should be reserved. 
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whereby needless transmission can be avoided. 
[0110] Further, the target information may include 
user interface information of the target The user inter- 
face information may be the target name expressed by 
a character string, the model name that is the model 5 
number of the product indicated by a character string by 
the maker, a still-picture object indicating the target 
such as an icon of the target, etc. 
[0111] Hereinafter, the function chart 8 will be 
described. The function chart 8 is a chart showing the io 
operation display information for constituting the opera- 
tion display of the target mentioned above, that is, the 
information showing the functions and states of the tar- 
get. The function chart 8 includes objects required for 
constituting the operation display of the target, and each i5 
object includes ID information for identifying the object, 
for example, an ID number or information indicating the 
type of the object. 

[0112]. The objects will be described briefly. As long 
as the objects can be identified, the target may use arbi- 20 
trary characters or numbers as the ID information, and 
the meaning of the characters or numbers may be 
unique to the target. Thereby, the load on the target 
when the target assigns the ID information can be 
reduced. 25 
[01 1 3] The objects are as follows: display data such 
as text data or still-picture data; display parts each indi- 
cating the display data and its attribute information; 
groups each comprising several pieces of display parts; 
and a panel used as a menu indicating the operations 30 
and states of the target, on which the display elements 
such as the display parts and the groups are put 
together. Each display part comprises the following dis- 
play data: still-picture data of an operation button or the 
like of the device, text data indicating a function or the 35 
like, audio data such as an effective sound, and a pro- 
gram code including still-picture data and text data. The 
display part may have attribute information. 
[0114] The information of the object is as follows: a 
data object comprising display data, a list of the display 4o 
parts and the display elements, attribute information 
such as various kinds of header information and unique 
information, and ID infomnation. 

[01 1 5] Each object has a list type hierarchical struc- 
ture, and in the following description, each data object 45 
and its list are called "object". However, each object 
does not necessarily have the list structure, and it may 
be composed of only the data object or the attribute 
data and the data object, as long as it can be identified 
by the ID information or the like. so 
[0116] Information of the function chart 8 compris- 
ing these data is transmitted to the controller, through 
the function information management means 19, the 
second protocol processing means 18, and the asyn- 
chronous data transmission/reception means 5, in 55 
response to a request from the controller on the trans- 
mission line 1. 

[01 1 7] The function chart 8 is stored in the ROM 1 5 



and the RAM 1 6. To be specific, the information which is 
unique to the target and so is not rewritten frequently, 
i.e., the objects such as the still-picture data indicating 
the operation button of the target, are stored in the ROM 
15: The ROM 15 may be implemented by a flash ROM. 
When using a flash ROM, the functions of the device 
can be rewritten. 

[0118] Further, in the RAM 16 where the function 
chart 8 is stored, the controller on the transmission line 
1 or the inside-of-device control means 9 writes the 
objects as required through the function infomnation 
management means 17. The information so written is 
contents information, operating state information, or the 
like. 

[0119] When the target is a broadcast receiver such 
as a STB, the contents information is program informa- 
tion such as the title of a program which is currently 
broadcast, the title image, the theme music, the outline, 
the cast, and the like. When the target is a recorder for 
recording data on a DVD or the like, the contents infor- 
mation is information recorded on the DVD disk such as 
the title, the title image, the theme music, the outline, the 
cast, and the like. 

[0120] In the case of a VTR, the operating state 
information is the objects corresponding to the display 
parts indicating the operating states of the device, such 
as "playback", "fast-reverse", "programming", and the 

like. 

[0121] Further, the following information may be 
written in the RAM 1 6: information required for network 
control such as the ID information of the controller which 
uses this target, the date of reserved program, and the 
channel number. 

[0122] In this description, the infomnation indicating 
the states of the target includes the contents information 
and the operating state information described above. 
Further, it also includes the state of each display part 
such as the still picture when the user pushes the play- 
back button of the VTR, and the still picture when the 
user releases the button. 

[0123] Next, the function information management 
means 17 will be described. This means 17 performs 
conversion of the object ID information indicating the 
object ID or the type of the object into an address in the 
ROM 15 or the RAM 16, and management of each 
object. Further, not only conversion into the address, it 
assigns a new address when the display part is updated 
and so the data size increases and therefore the data 
cannot be written in the original address area. 
[0124] Accordingly, the function information man- 
agement means can read and writes each object, 
according to the object ID infomnation, from the control- 
ler on the transmission line 1 , the inside-of-device con- 
trol means 9, and the first protocol processing means 6. 
[0125] When the address of each object is known in 
advance, the object may be read or written by using the 
address of the ROM 15 or the RAM 16. Further, the dis- 
play part or the like can be read or written by using a 
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combination of them, and the display part can be read 
or written according to the relative address in the dis- 
play part indicated by the object ID information. 
[0126] The function information management 
means 17 manages the object ID information as follows. 
When a new object is added, this means 17 provides 
this object with ID Information that is not used by other 
objects, and when an object is deleted, the means 17 
nullifies the ID information of this object. 
[0127] Further, when the object is changed by the 
target itself, the function information management 
means 1 7 spontaneously transmits the changed object 
to the controller. Therefore, the controller need not 
observe the object which might be changed, whereby 
the processing of the controller is reduced and so the 
controller can deal with the objects indicating the status 
information and the contents information which change 
momentary. 

[0128] When the function information management 
means 1 7 is provided with a notification range for notify- 
ing the controller that the information within a specific 
range of the target has been changed, the controller is 
prevented from being given undesired data at an arbi- 
trary point of time from the target and, therefore, the 
controller is prevented from processing the undesired 
data. As the result, the processing efficiency is 
increased. 

[0129] The function information management 
means 17 may transmit only the ID information of the 
changed object to the controller instead of transmitting 
the changed object to the controller. In this case, the 
controller sends a request for transmission of the 
changed object by the first protocol by using the ID infor- 
mation of the object, and obtains the changed object by 
the second protocol. 

[0130] Next, the inside-of-device control means 9 
will be described. This means 9 is for controlling the 
respective constituents including the mechanism inside 
the target. When the data received by the first protocol 
processing means 6 is the control code indicating the 
operation of the target, the first protocol processing 
means 6 instructs the inside-of-device control means 9 
to perfomn operation according to this control code. 
[0131] Further, the inside-of-device controller 9 
processes the information in the notification range 
included in the data request from the controller. The 
notification range included in the data request from the 
controller is a range in which the target notifies the 
change when the state or function of the target has 
been changed. A range desired by the controller is des- 
ignated as the notification range to be included in the 
data request from the controller. That is, the inside-of- 
device control means 9 obtains information about the 
notification range from the data request from the con- 
troller, and when the state or function of the target is 
changed, the means 9 notifies the controller of the 
change in this notification range by using the second 
protocol. Either the whole function chart 8 (all of the 



infomiation included in the function chart 8) or each 
constituent of the function chart 8. that is. either a panel 
unit or a display part unit, is designated as the notifica- 
tion range. When there are plural controllers, the inside- 
5 of-device control means 9 informs the change to only 
the controller whose notification range includes the 
changed state or function, according to the notification 
range of each controller. 

[0132] Although the notification range is either the 
10 whole function chart 8 or each constituent of the func- 
tion chart 8, the whole target including the function chart 
8 and the target information may be designated as the 
notification range, with the same effects as described 
above. 

15 [0133] The inside-of-device control means 9 per- 
forms version management for the information in the 
function chart 8, in addition to the operations mentioned 
above. The version number used for the version man- 
' agement . is generated by using a counter, and the 

20 inside-of-device control means 9 increments the coun- 
ter inside the version data generation means 1 8 every 
time the information stored in the RAM 16 in the function 
chart 8 is changed by the function information manage- 
ment means 1 7. 

25 [0134] The version data indicated by the counter 
value includes function chart version information indi- 
cating the version of the function chart 8, and constitu- 
ent version infomnation indicating the version of each 
constituent of the function chart 8 such as the function 

30 menu, the display part, the data object, etc. 

[0135] When the target receives a message from 
the controller indicating a request for data in the target, 
the target transmits the data to the controller. Since the 
version data corresponding to this data is included in 

35 this data, the controller can confirm the version data of 
the received data. That is, the controller can always use 
the latest data, and the reliability of the data is 
increased. Further, when the controller caches the data, 
the controller can easily decide whether the information 

40 in the function chart 8 is changed or not, according to 
the state change in the target, whereby the controller 
can cache the data easily and effectively. 
[0136] Next, the second protocol used by this target 
will be described. The second protocol is a protocol d'lf- 

45 ferent from the first protocol. In the second protocol, 
data transmission is performed after creating a connec- 
tion between a transmitter and a receiver, and a 
response is sent back to only a certain transmitter. 
[01 37] For example, initially the transmission mode, 

50 such as the address where data is to be written and the 
buffer size for continuous writing, is decided by 
exchanging information between the transmitter and the 
receiver, and a connection is created. Then, data is writ- 
ten in the receiver by continuously performing plural 

55 times of 1394 write transactions. As an example of this 
method, there is Asynchronous Serial Bus Connections 
discussed in the 1394TA. 

[0138] Further, as another example of the second 
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protocol applicable to this target, there is stream data to 
be transmitted by using the Isochronous transnnission 
method according to the IEEE 1394-1995. This stream 
data is data of an audio or video signal. In this case, bit 
map data or the like can be laid as GUI data over the 5 
audio or video stream data. Further, the GUI data is, for 
example, bit map format data which is known as icon, 
still-picture animation, JPEG, or BMP, or AIFF audio for- 
mat data used for effective sound or the like. 
[0139] The second protocol transmission means 18 10 
performs processing at the target end of the second 
protocol, i.e., the processing at the transmitter. This 
means 18 receives the information of the function chart 
8 from the function information management means 1 7, 
and performs data transmission through the asynchro- is 
nous data transmission/reception means 5. The con- 
nection/disconnection of the target to the connection is 
performed by the inside-of-device control means 9 
using the first protocol, through- the first protocol 
processing means 6 and the asynchronous data trans- 20 
mission/reception means 5. 

[0140] Hereinafter, a description will be given of the 
operation of the target comprising the above-described 
constituents, in response to a request from the control- 
ler. 25 
[0141] Initially, when the target is connected to the 
transmission line 1 or the controller is connected to the 
transmission line 1 , the controller reads the device con- 
struction information 7 of the target, and confirms the 
location of the information relating to the target (e.g., the 30 
type of the device, and the presence or absence of GUI 
data), and reads the infomnation. The device construc- 
tion information 7 may have the address information of 
the function chart 8. or it may show only the existence. 
[0142] Next, the controller creates a connection for 35 
the second protocol between itself and the target Then, 
the controller issues, to the target, a data request which 
requests the objects in the function chart 8, i.e., the 
panel, the display parts, and like) to obtain the informa- 
tion of the function chart 8. At this time, the controller 40 
may issue a command requesting a part of the function 
chart 8. e.g., only a display part, to obtain only the dis- 
play part and its ID. 

[0143] Further, when the target receives the control 
code and the user operation information from the con- 45 
troller. the target performs the processing indicated by 
the control code and the user operation information, 
according to the situation. For example, with respect to 
an object such as a display part indicating the function 
of the target, when the control code of this object is so 
transmitted from the controller to the target together 
with 'selection" as the user operation information, the 
asynchronous data transmission/reception means 5 
instructs the inside-of-device control means 9 to exe- 
cute the function indicated by this object. As the control ss 
code of the object, the ID information of the object such 
as the ID infomnation of the display part, is used. 
[0144] In this way, the target presents only the infor- 



mation of the function chart 8 in response to the request 
for the GUI data from the controller, whereby the load on 
the target can be reduced. Further, it is not necessary 
for the group of standardization to define a command for 
each function of the target, and even when the target 
has a new function which cannot be supposed at 
present, the user can easily use this new function 
through the transmission line 1 . 

[0145] In the target described above, the constitu- 
ents such as the synchronous data transmission/recep- 
tion means 3 and the target signal processing means 4 
may be arbitrarily constructed according to the functions 
of the target, and these constituents may be dispensed 
with in some cases. Further, each means may be con- 
stituted by either hardware or software. 
[0146] While in the target according to this first 
embodiment each function of the target is specitied 
according to the user operation information and the 
object control code, it may be constructed so that the 
user operations other than "selection" cannot be recog- 
nized. In this case, since the function of the target can 
be specified by only the control code of the object, the 
target can execute the function by the control code 
alone, whereby the size of the packet to be transmitted 
can be reduced. 

[0147] Further, while in the target of this first 
embodiment the control code is used as the object ID 
infomnation, the control code may be arbitrarily set by 
the target. For example, the control code may be com- 
posed of a number given for each type of the function of 
the target, and a serial number for each type. Alterna- 
tively, a unique control code used inside the target may 
be used. Thereby, mounting of each function in the tar- 
get is facilitated. 

[0148] Next, a description will be given of a control- 
ler used in the network control system for the AVC sys- 
tem, with reference to the drawings. 
[0149] Figure 3 is a block diagram illustrating a con- 
troller in the network control system according to the 
first embodiment of the invention. In figure 3, 20 
denotes a first protocol processing means, 1 0 denotes a 
controller signal processing means, 1 2 denotes a func- 
tion chart management means, 13 denotes a function 
data base, 14 denotes a display/function selection 
means, and 19 denotes a second protocol transmission 
means. 

[0150] Hereinafter, these constituents will be 
described in brief. In figure 3, the same reference 
numerals as those shown in figure 2 denote the same or 
corresponding parts. 

[0151] Initially, the controller signal processing 
means 10 receives synchronous data from the synchro- 
nous data transmission/reception means 3, and per- 
forms signal processing according to the controller. For 
example, when the controller is a device capable of dis- 
playing video, such as a video monitor, the processing 
means 10 decodes the synchronous data, e.g., an 
MPEG2 stream, and displays it on a screen. 
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[0152] The first protocol processing means 20 
receives the information about the target on the trans- 
mission line 1, such as connection of a new target con- 
nected or disconnection of the existing target, from the 
packet transmission/reception means 2 through the 
asynchronous data transmission/reception means 5, 
and transmits it to the display/function selection means 
14 which will be described later. Further, the first proto- 
col processing means 20 performs, according to the first 
protocol, connection/disconnection of the connection for 
the second protocol, and transmission/reception of a 
message for controlling the target. 
[0153] The function data base 13 is placed in the 
rewritable memory space, and includes the function 
chart 8 received from the target as a data base. By 
searching this data base using the function chart man- 
agement means 12 which will be described later, the fol- 
lowing data can be taken out: the object such as the 
Information of each target or the information of each 
function, the ID information of the object, the display 
part for notifying the user of this object, and the display 
part to be displayed or the control code to be transmit- 
ted when the user operates this display part The func- 
tion data base 1 3 does not necessarily have all of the 
information in the function chart 8, it may have only nec- 
essary part of the function chart 8. 
[0154] When the controller and the target are 
included in the same device, it is not necessary to indi- 
cate the functions of the target in this device to the con- 
troller. Further, the inside of the device is controlled by 
the inside-of-devk:e control means 9. Therefore, 
although the target has the function chart 8 to be used 
by another controller, it is not necessary to record this 
function chart 8 in the function data base 13 of the con- 
troller. Furthermore, when the controller and the target 
are included in the same device, the location of the 
function chart 8 may be written in the device construc- 
tion data 7, or it may be recorded in the function data 
base 1 3 In advance. 

[0155] The second protocol transmission means 1 9 
performs the processing of the second protocol at the 
controller end, i.e., the processing at the receiver. This 
means 19 receives the function chart 8 or the like from 
the target through the asynchronous data transmis- 
sion/reception means 5. and transmits it to the function 
chart management means 12 which will be described 
later. The inside-of-device controller 9 performs connec- 
tion/disconnection of the target toArom the connection 
according to the first protocol through the first protocol 
processing means 20 and the asynchronous data trans- 
mission/reception means 5. 

[0156] Next, the function chart management means 
1 2 is means for managing the information in the function 
chart 8 which is supplied from the target on the trans- 
mission line 1 . 

[01571 Th6 information management will be 
described in brief. When the function chart manage- 
ment means 12 receives information that a new target is 



connected, from the asynchronous data processing 
means 5, the management means 12 instructs the 
asynchronous data transmission/reception means 5 to 
read the information of the function target 8 of this new 
5 target. 

[01 58] When the information of the function chart 8 
of the new target and Its version information are read, 
the management means 12 records this function chart 8 
in the function data base 13, and stores the version 
10 information of the function chart 8 in association with 
the function chart 8. 

[01 59] The version information may be stored in the 
function data base 1 3 together with the function chart 8, 
or it may be stored in and managed by the function chart 
15 management means 12. Further, when a constituent of 
the function chart 8 is read together with its version 
information, this constituent is associated with the ver- 
sion information and stored in the function chart 8 of the 

controller. The version information of the constituent 

20 may be stored in and managed by the function chart 
management means 12. 

[0160] Further, when the function chart manage- 
ment means 1 2 receives information that an existing tar- 
get is disconnected from the transmission line 1, this 

25 management means 12 deletes the corresponding 
function chart 8 from the function data base 13. 
[0161] When the existing target Is disconnected, 
the function chart 8 of this target may be stored in the 
storage means in the controller. When this target is con- 

30 nected again, this target is identified by its ID or the like, 
and the corresponding function chart 8 is read from the 
storage means to be recorded in the function data base 
13. Thereby, registration of connected devices can be 
perfomned speedily. 

35 [0162] The function chart 8 in the controller may be 
different in form from the function chart 8 in the target as 
long as these function charts include the same informa- 
tion. Further, the function chart 8 in the controller is not 
necessarily in the form transmitted on the transmission 

40 1 by the second protocol. 

[0163] Next, the display/function selection means 
14 is means for displaying the display part indicating the 
GUI information of the target or the GUI information of 
the function received by using the second protocol (e.g., 

45 video information, audio information, or text information) 
on the screen of the controller, and notifying the user of 
this display part. Further, this means 14 selects a target 
or function according to the user operation, and 
instructs execution of each function by using the first 

so protocol. 

[0164] Further, the display/function selection 
means 1 4 can display or play the data received from the 
controller signal processing means 10 (e.g., video or 
audio data) or the data received from the first protocol 
55 processing means 20 or the second protocol transmis- 
sion means 19. At this time, the GUI information may be 
laid over the video data received from the controller sig- 
nal processing means 1 0, or the display (screen) may 
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be switched between the GUI information display and 
the video data display according to the user instruction 
or the like. 

[0165] Further, the displayAunction selection 
means 14 instructs the function chart management 
means 12 to search the function chart 8, and displays 
the display part showing the target on the transmission 
line 1 or the function of the target (e.g., the target name, 
the function name, or the still-picture for display) on the 
screen. 

[0166] Hereinafter, a description will be given of the 
operation of the controller constituted as mentioned 
above. 

[0167] Initially, when the user selects a display part 

indicating a target, the controller reads the panel (menu) 
of this target from the function chart 8 and displays it on 
the screen. 

[0168] Next, when the user selects a display part 
indicating a function from the panel, the controller 
issues the control code and the user operation data, 
which correspond to this display part and are obtained 
from the function chart 8, through the first protocol 
processing means 20. The display/function selection 
means 14 receives a response of the target to the con- 
trol code and the user operation data, through the first 
protocol processing means 20. 

[0169] Further, when the controller is informed that 
the object is changed, from the target by the second 
protocol, for example, when it receives the changed 
object, the controller displays the changed object on the 
screen. Therefore, the controller can display the latest 
GUI with respect to the state of the target at the present 
time to inform it to the user. 

[0170] The object can be managed by using the 
version information. In this case, when the object to 
which the version information is added is transmitted 
from the target, the controller checks the version infor- 
mation and displays the object only when the version 
information is updated. 

[0171] Since the controller operates as described 
above, when the target distributes the function chart to 
plural controllers, each controller need not perform use- 
less operation even when a specific controller requires 
the data of the same version due to restriction on this 
controller such as memory capacity, whereby the 
processing is simplified and preferable display with less 
updation is performed. 

[0172] Further, the controller does not necessarily 
recognize each function of the target. For example, 
even when a target has a new function that cannot be 
supposed at present, the controller can take the display 
part corresponding to this new function from the func- 
tion chart 8 and display it on the screen to inform the 
user of this new function. When the user recognizes the 
new function and selects it, the display/function selec- 
tion means 14 of the controller obtains the control code 
corresponding to this new function with reference to the 
function chart 8, and issues this control code and the 



user operation to the target so as to make the target 
execute this new function. Accordingly, by adopting the 
construction mentioned above, the user can execute 
even a new function which cannot be supposed at 
5 present. 

[0173] In this first embodiment, the constituents 
such as the synchronous data transmission/reception 
means 3 and the controller signal processing means 10 
may be arbitrarily constituted according to the functions 

10 of the controller. Further, the constituents such as the 
synchronous data transmission/reception means 3 and 
the controller signal processing means 10 may be dis- 
pensed with according to the functions of the controller. 
[0174] Next, a description will be given of the 

15 method of connecting/disconnecting the devices to/from 
the connection for the second protocol, with reference to 
the drawings. 

[0175] Figures 4(a) and 4(b) are diagrams illustrat- 

ing the method of connecting/disconnecting the devices 

20 to/from the connection used by the second protocol, 
and figure 4(a) shows the case where there is an initia- 
tor while figure 4(b) shows the case where there is no 
initiator. In the figures, 40 denotes an initiator, 41 
denotes a controller, and 42 denotes a target. 
25 [0176] The connection is a path for data transmis- 
sion which is logically constituted for the data flowing on 
the transmission line 1 , and the target and the controller 
may possess plural connections. In this case, each con- 
nection designates an address for data transmis- 
30 sion/reception by using a logical plug number or port 
number, and each connection is distinguished from 
another connection by the plug number or the port 
number. 

[0177] First of all, the case where the initiator is 
35 present will be described. In figure 4(a). the initiator 40 
creates a connection of the second protocol between 
the controller 41 and the target 42. In this connection, 
the transmitter of the data transmitted by the second 
protocol is the target 42, and the receiver is the control- 
40 Ier41, 

[0178] The initiator 40 obtains, from the controller 
41, the information required for connection, e.g., the 
controller's resource information such as an address of 
a connectable buffer, and tries to connect the target 42 

45 to the connection by using this information. When this is 
successful, the initiator 40 tries to connect the controller 
41 to the connection. In this way, the connection is 
established between the controller 41 and the target 42. 
[0179] Further, also when disconnecting the 

50 devices from the connection, the initiator 40 discon- 
nects the controller 41 from the connection, and then 
disconnects the target 42 from the connection. When 
this is successful, the initiator 40 releases the resources 
which have been reserved for connection by the control- 

55 Ier41. 

[0180] Next, a description will be given of the case 
where the initiator is absent. In figure 4(b). the controller 
41 creates a connection of the second protocol between 
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the controller 41 and the target 42. In this connection, 
the transmitter of the data transmitted by the second 
protocol is the target 42, and the receiver is the control- 
ler 41. That is, the controller doubles as the initiator 
shown in figure 4(a). 

[0181] The controller 41 obtains information 
required for connection of itself, e.g., resource informa- 
tion such as an address of a connectable buffer, and 
tries to connect the target 42 to the connection by using 
the information. When this is successful, the controller 
41 tries to connect itself to the connection. In this way, 
the connection is established between the controller 41 
and the target 42. 

[0182] Also when disconnecting the devices from 
the connection, the controller 41 disconnects itself from 
the connection, and then disconnects the target 42 from 
the connection. When this is successful, the controller 
41 releases the resources which have been secured for 
connection by itself. 

[0183] Since this connection establishment method 
depends on the second protocol, the initiator creates 
the connection by a method suited to the second proto- 
col. 

[0184] Next, a description will be given of the con- 
struction of the function chart 8 according to this first 
embodiment, with reference to the drawings. 
[0185] Rgure 5 shows the function chart 8 
described with respect to figures 2 and 3, and this chart 
has one panel. In figure 5, the panel, group, and display 
part are referred to as "display elements". 
[0186] The panel shows the GUI information in the 
target, and it is constituted by using a list. 
[0187] The group shows an aggregate of display 
elements in the panel, and this is constituted by using a 
one-dimensional array. Since the group is not necessar- 
ily required, this may be omitted. When the group is 
omitted, ID information of each display part may be 
directly written in the panel list. 

[0188] The display part shows an icon, a button, or 
the like, and this may have ID information of display 
data. The display data shows actual data of the display 
part, such as still-picture data, audio data, text data, etc. 
The function chart 8 may have plural panels. 
[0189] The panel, group, display part, display data 
are generically referred to as •objects". Each object is 
shown as a one-dimensional array, and the array is 
composed of ID information and a data section, i.e.. 
attribute information, or actual data. ID information of 
another object may be written in the attribute informa- 
tion and, in this case, each object can have a list struc- 
ture. 

[0190] Each object has ID information for identifying 
the object, and the ID information is constituted using an 
ID number as an identifier, type information indicating 
the type of the object, and the like. The object is speci- 
fied by them. 

[0191] Each object also has attribute information. 
The attribute information In each object has ID informa- 



tion for identifying the attribute of the object, and this ID 
information Is constituted using an ID number as an 
identifier, type information indicating the type of the 
attribute, and the like. Each attribute information is 

5 specified by them. 

[0192] Besides the information mentioned above, 
each object has its own information. This information is 
unique to each object, for example, object's version 
information, size information, arrangement information, 

10 font size information, etc. Each of the unique informa- 
tion is written in each object as attribute information. 
[0193] Further, the ID information of the display ele- 
ment or the display part to be referred to, shows the link 
between objects. Thereby, it shows an aggregate such 

IS as the panel or the group. Further, when the display part 
has links to the display data, plural display parts can 
share the same display data. The ID information of the 
object to be referred to Is handled as attribute informa- 
tion, and it has reference infomiation as a kind of 

20 attribute information discriminated by ID information. 
[01 94] The physical/logical construction of the func- 
tion chart 8 in the controller or the target does not nec- 
essarily have the construction shown in figure 5, and the 
construction is not restricted thereto as long as the con- 

25 troller and the target can share information of the same 
contents. 

[01 95] To be specific, each part of the function chart 
8 does not necessarily have the link shown in figure 5 as 
long as the part can be accessed in object units from 

30 the controller. 

[01 96] As described above, since the ID information 
and the unique information of the objects to be referred 
to are Integrated in the same format as attribute infor- 
mation, the processes performed by the controller are 

35 reduced, whereby the code size of the program is 
reduced, resulting in simplified processing. Further, 
when creating the data of the function chart, debug, 
alteration, and formation are facilitated. The form of the 
function chart is not restricted to a list, it may be a table 

40 or a directory. 

[0197] Further, the target may have plural panels 
like other objects, and it may designate a desired panel 
when the controller reads the function information. 
[0198] Further, the panel may be composed of one 

45 main panel and plural sub-panels. In this case, display 
parts indicating links to the sub-menus are written in the 
attribute information indicating the reference objects of 
the main panel. At this time, each display part shows the 
sub-menu of the reference object by a still picture or text 

50 data. When the user selects this display part on the con- 
troller, the controller displays the sub-menu of the refer- 
evce object on the screen. The subnnenu is as follows: 
an operation menu indicating a function in the target, a 
help menu indbating how to use, a contents menu com- 

55 prising only contents information in the target, an edition 
menu for edition work, or a setting menu for setting the 
target. IHowever, the sub-menu is not restricted thereto. 
[0199] Hereinafter, a description will be given of the 
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operations of the controller and the target in the network 
control system according to the first embodiment, with 
reference to the drawings. 

[0200] Rgure 6 is a diagram for explaining the net- 
work control system according to the first embodiment. 5 
The following description will be given of the case where 
the system has no initiator, i.e., where the controller 
doubles as an initiator. 

[0201 ] Rrst of all, when a target is connected to the 
transmission line 1, the controller on the transmission w 
line 1 recognizes the new target by a bus reset signal or 
the like, and reads the information of the new target, 
which is written in the device construction information 7, 
from the new target through the transmission line 1, 
under instruction of the function chart management is 
means 12. Then, the controller reads the data objects 
indicating the target itself, e.g., text object, still-picture 
object, etc., and records these data in the function data 
base 13 of the controller. : ^ 

[0202] At this time, the display/function selection 20 
means 14 refers to the function data base 13 through 
the function chart management means 12, and displays 
the chart of the target connected to the controller, using 
the data object indicating the target itself. 
[0203] Next, when the user selects the still-picture 25 
object of the target by using a pointing function (e.g., 
crosshairs key) of the remote controller, the dis- 
play/function selection means 14 makes a request for 
the GUI information of the target to the function chart 
management means 12, reads the panel (menu) of the 30 
target, and stores it in the function chart 8 of the control- 
ler. 

[0204] At this time, the controller reserves 
resources in the controller required for the second pro- 
tocol, and transmits a message 101 shown in figure 6, 35 
i.e., a request for making a connection, to the target by 
the first protocol. Next, it is checked as to whether the 
target is connectable to the connection or not, and when 
it is connectable, the target is connected to the connec- 
tion. Then, the controller confirms that the target 40 
acknowledges the request, by a message response 
111, and connects itself to the connection, whereby the 
connection is established. 

.[0205] Next, the controller transmits a request for 
data transmission by a message transmission 102 to 45 
the target. This message transmission 102 includes 
information of a notification range within which the con- 
troller desires to match the information with that of the 
target. As a response to this transmission, the target 
returns primary response 112, and transmits the data of so 
the panel (main menu) in the function chart 8 to the con- 
troller by the second protocol. 

[0206] At this time, the controller may notify the 
information indicating the notification range to the tar- 
get. In this case, the target does not notify the controller ss 
of a change in unnoticed information such as informa- 
tion that is not currently displayed by the controller. So, 
the controller is prevented from being supplied with 



unnecessary data at the present time and being com- 
pelled to process the data, whereby the throughput of 
the controller is improved. 

[0207] The message response 1 1 2 may include the 
version information according to the notification range. 
At this time, the controller can obtain the version infor- 
mation of the function chart of the target in advance of 
reading the function chart So, the controller need not 
read the function chart again if the function chart is the 
same as the function chart which has already been 
cached by the controller, and the controller may discard 
the transmitted data. That is, the controller is prevented 
from performing unnecessary data updation and screen 
updation. and the controller can provide the user with a 
user-friendly screen and, therefore, the processing of 
the controller is simplified. Further, the data transmitted 
by the second protocol may be either the whole data of 
the function chart 8 or the panel designated by the mes- 
sage transmission 1 02. - 

[0208] In this way, the controller obtains the whole 
data of the panel, and displays the data on the screen. 
The notification range may be transmitted to the target 
by the message transmission 101 , with the same effects 
as described above. Further, the message response 
111 may include the version information of the function 
chart of the target. At this time, the controller can obtain 
the version information of the function chart of the target 
before performing the message transmission 102, and 
the controller need not read the function chart again if it 
Is the same as the function chart which has already 
been cached by the controller. This saves the trouble of 
transmitting the function chart, resulting in reduced 
amount of data to be transmitted. 
[0209] Next, when the user selects the display part 
indicating the playback function of the target by using 
the pointing function of the remote controller such as a 
crosshairs key which shows the up, down, left, and right, 
the display/function selection means 1 4 transmits the ID 
information of the display part given by the target, as a 
control code, to the target together with the user opera- 
tion information such as "selection". That is. after the 
user moves the cursor onto the display part by using the 
crosshairs key showing the up, down, left, and right and 
pushes the "selection" button, even when the user 
moves the cursor out of the display part, the ID informa- 
tion (control code) of this display part and the user oper- 
ation information ("selection") are transmitted as a 
message transmission 103 to the target. 
[0210] Further, more precise user operation infor- 
mation can be transmitted to the target. That is, when 
the user performs operations like "push", "release", 
"push twice" on the display part by using the remote 
controller or the pointing target, the information of these 
operations can be transmitted to the target. Further, as 
more precise operation information, the operation infor- 
mation of the remote controller it self, such as that the 
user pushed button "1 " of the remote controller, can be 
transmitted directly to the target. 
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[0211] The user operation Information may be 
coded and transmitted together with the ID information 
of the display part, or each operation infomnation may 
be transmitted as a command (operand is the control 
code such as the ID information of the display part). 
[0212] When only "selection" is permitted with 
respect to the display part, the controller is constructed 
so that it transmits only the control code (ID information) 
of the display part to the target In this case, the 
processing is simplified, and the traffic on the transmis- 
sion line 1 is reduced. 

[0213] Next, as a response to the operation 
request, the target returns a message response 113 
Indicating that the message transmission 103 is 
received, or rejected, or not supported kjy the target. 
[021 4] The message response 113 may include the 
version information. In this case, the controller can know 
whether the data of the function chart is changed or not 
according to the message transmission 103, before the 
controller's making the next request for data or before 
the target's transmitting data spontaneously. So, the 
controller can prepare for screen updation or the like in 
advance, whereby the controller can provide the user 
with an easily-readable display. 

[0215] When the state of the target is changed and 
thereby the object inside the target such as the function 
menu list, the display part list, or the data object is 
changed, the target spontaneously transmits the 
changed data (display part) to the controller by using 
the second protocol. The changed data (display part) is 
not restricted to one. When plural display parts are 
changed at one time, the target can transmit the plural 
display parts. Transmission of the changed data is per- 
formed not only by the user operation but also by the 
target when the state of the target is changed. 
[0216] While in the above-description data trans- 
mission Is performed in display part units, only the 
attribute information which is changed may be transmit- 
ted. In this case, the changed attribute information is 
transmitted together with the ID information of the 
changed display part. Likewise, when only the display 
data is changed, only the display data is transmitted to 
the controller. By transmitting only the changed attribute 
infomnation or display data as described above, the 
quantity of data to be transmitted is reduced, whereby 
the responsibility is improved, and the processes per- 
formed by the target and the controller are reduced. 
[0217] Further, when the panel unit is designated 
as the notification range and the display menu is 
changed by the user operation or the like, the target 
transmits a new panel to the controller, and only when 
the information in the new panel is changed, the target 
notifies the controller of the change in the target infor- 
mation. Thereby, the controller can obtain the state 
change information with simple structure and efficiency, 
I.e., with less storage area. This is not restricted to the 
panel and is applicable to every display part 
[0218] The function chart management means 12 



writes the data of the changed display part In the corre- 
sponding function chart 8 to update the function chart 8, 
and the display/function selection means 14 displays 
the function chart 8 so updated. 
5 [021 9] When the controller ends display of the func- 
tion chart 8 of the target, the controller disconnects itself 
from the connection, and makes a message transmis- 
sion 104 (disconnection request) to the target by the 
first protocol. 

10 [0220] The target checks whether disconnection 
from the connection is proper or not, and disconnects 
itself from the connection when it is proper. 
[0221] When the controller checks by a message 
response 1 1 4 that the target acknowledges the request, 

15 the controller releases the resources required for the 
second protocol, which have been stored by itself. 
[0222] In the above description, the connection is 
created when the controller displays the information of 
the target on the screen. However, the connection may 

20 be created while power is on the target, or it may be cre- 
ated when the controller displays the GUI information of 
the function chart of the target The same can be said of 
disconnection. 

[0223] Further, information indicating a forced mes- 
25 sage to the user may be added in the ID information or 
attribute information of the data transmitted by the sec- 
ond protocol. When the controller receives this data, 
display or audio playback is performed compulsorily. 
[0224] As described above, when an operation 
30 which is not permitted by the target, such as overlap of 
program resen^ations, is performed or when an abnor- 
mality, such as entangled tape of VTR, occurs in the tar- 
get, a warning or instruction can be given to the user by 
using GUI information such as video and audio. 
35 whereby the user can perceive the status of the target 
correctiy and quickly. 

[0225] As the data to be transmitted by the second 

protocol, OSD (On Screen Data) may be constituted by 
using bit map, text data, and the like of a part or the 

40 whole of the screen, and the controller may display the 
OSD on the screen. Further, the location of the OSD on 
the screen of the controller may be decided by the con- 
troller. In this case, the OSD is displayed with an appro- 
priate size and in an appropriate position according to 

45 the screen size and the aspect ratio, for the user. 

[0226] Further, the message response may include 
the version information. In this case, it is decided 
whether the data transmitted by the second protocol is 
correct data or not by deciding whether this version 

50 information matches that of the data transmitted by the 
second protocol. In this case, it is not necessary for the 
controller to obtain all of the data transmitted by the sec- 
ond protocol, whereby the processing of the controller is 
simplified, resulting speedup. 

55 [0227] Further, a specific value of the version infor- 
mation may have a meaning. For example, when the 
value of the version information is "0*. the correspond- 
ing display part is "invariable". That is, invariable display 
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parts and variable display parts can be handled without 
additional information, whereby the processing of the 
controller is simplified, and the quantity of information is 
reduced. 

[0228] Next, the transmission/reception operation 
of the controller will be described with reference to the 
drawings. 

[0229] Figures 7(a) and 7(b) are flowcharts each 
illustrating the operation flow of the controller. Figure 
7(a) shows the operation relating to the first protocol, 
and figure 7(b) shows the operation relating to the sec- 
ond protocol. These flows shown in figures 7(a) and 
7(b) are performed in parallel with each other on the 
controller. 

[0230] In figure 7(a), the controller establishes a 
connection for the second protocol, to the target, 
according to a request inside the controller such as 
user's pushing a menu button on the remote controller 
(step 501). Then, in order to display the GUI information 
of the target according to the user operation, the con- 
troller transmits a message indicating a request for the 
data to the target (step 502). The controller waits for a 
response to this request (step 503), and detects the 
user operation after receiving the response from the tar- 
get (step 504). 

[0231] When the user performs an operation on the 
screen of the controller and the controller notifies the 
target of this operation, the ID information of the object 
and the user operation information are transmitted to 
the target (step 502). 

[0232] On the other hand, when there is no user 
operation, it Is decided whether the processing is to be 
ended or not (step 505). When it is decided by the user 
operation or the like that the controller need not display 
the GUI information of the target, the target is discon- 
nected (step 506). On the other hand, when it is decided 
that the controller should continue to display the GUI 
information of the target, the user operation to be trans- 
mitted to the target is checked (step 504). 
[0233] The operation flow shown in figure 7(b) is 
started after the controller has established the connec- 
tion in step 501 of figure 7(a). Initially, in step 510, the 
controller checks whether it receives data or not by the 
second protocol. When the controller receives data, the 
controller checks the version number (step 51 1). When 
it is newly read data or has different version information, 
the data stored In the controller is updated (step 512), 
and the version information is updated (step 513), and 
then the display is updated (step 514). When the ver- 
sion information is the same, steps 512 to 514 are 
skipped and the display is not updated. 
[0234] After the display is updated in step 514 or 
when the controller receives no data in step 510, it is 
decided whether the operation flow is to be ended or not 
(step 515). When it is decided by the user operation or 
the like that the controller need not display the GUI infor- 
mation of this target, the operation flow is ended. On the 
other hand, when it is decided that the controller should 



continue to display the GUI information of this target, 
the controller waits for next data (step 510). The END 
decisions in steps 510 and 515 may be performed at the 

same time. 

5 [0235] Next, the transmission/reception operation 
of the target will be described with reference to the 
drawings. Description of error handling during commu- 
nication is omitted. 

[0236] Figure 8 is a flowchart showing the operation 
10 flow of the target. Initially, the target waits for controller's 
establishing the connection (step 601), and after the 
connection has been established, the target checks 
whether there is a message from the controller (step 
602). When there is no message, the target checks Its 
75 internal state (step 603). When the state is not changed, 
the target decides whether the operation flow is to be 
ended or not (step 611). When the target is discon- 
nected from the connection by the controller or when 
the target receives an END message from the. control- 
20 ler, the target ends this operation flow. On the other 
hand, when the operation is to be continued, the control 
returns to step 602. 

[0237] When there is a message in step 602, the 
target decides the purpose of this message, and checks 

25 the state of the target and whether the target supports 
this function or not according to the message, and then 
transmits a message response to the controller accord- 
ing to the practicability of the message (steps 604 and 
609). When the received message is a request for data, 

30 the target decides its practicability (step 605). When the 
request is practicable, the target sends an acknowl- 
edgement to the controller and. simultaneously, creates 
a function chart (step 606). When the target has already 
have a function chart, the target transmits it to the con- 

35 troller (step 608). On the other hand, when the request 
is not practicable, the target transmits a message such 
as a rejection to the controller. 

[0238] Likewise, when the state of the target is 
changed in step 603, the function chart is updated (step 
40 607), and the function chart is transmitted to the control- 
ler (step 608). 

[0239] Further, when the received message is not a 
request for data but the ID information of an object and 
the user operation information, the target performs a 

45 process corresponding to this message (step 609). That 
Is, the practicability of the message is decided in step 
609. When it is practicable, the target transmits a mes- 
sage response (acknowledgement) to the controller, 
and performs a process con^esponding to this message 

50 (step 610). When the message Is not practicable, the 
target transmits a message such as a rejection to the 
controller. 

[0240] Although the END decision is made in step 
61 1 , when the target receives a message of disconnec- 
55 tion or a message about GUI display's being ended from 
the controller, the decision may be made in step 610 to 
end the operation flow. 

[0241] Next, a description will be given of the proc- 
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ess of confirming data transnnission by the second pro- 
tocol, with reference to the drawings. 
[0242] Rgure 9 is a diagrann for explaining the proc- 
ess of confinTiing data transmission by the second pro- 
tocol according to the present invention. Figure 9 shows 
the process of confirming the transmitted data from the 
message transmission 1 02 to the data 201 shown in fig- 
ure 6. In figure 9, the same transmission processes as 
those shown in figure 6 are given the same reference 
numerals. 

[0243] The controller makes a request for data by a 
message transmission 102, and the target returns, to 
the controller, a message response 112 indicating that 
the message is acknowledged. Then, the target trans- 
mits data 201 including version information, e.g.. a func- 
tion chart, by the second protocol. 
[0244] If a transmission error occurs in the trans- 
mission line, the target, or the controller and so the data 
201 Is not correctly transmitted to the controller, the con- 
troller detects the possibility that normal transmission 
has not been performed by the second protocol, accord- 
ing to timeout, or parity check, or data size check. 
[0245] Next, the controller confirms by a message 
transmission 105 as to whether the target has correctly 
outputted the data by the second protocol. Then, the 
target confirms whether the data transmission by the 
second protocol has been normally ended or not, when 
it has ended normally, the target returns a message 
response 115 of "acknowledgement", and when it has 
not ended normally* the target returns a message 
response 1 15 of "error" according to the situation. 
[0246] When a message indicating "already trans- 
mitted" or a message Indicating "transmission error* is 
returned as the message response 115, the controller 
recognizes that the data transmitted by the second pro- 
tocol has been lost or an error has occurred during 
transmission, and requests the data again by a mes- 
sage 122. On receipt of this request, the target informs 
the controller that the message is acknowledged, by a 
message response 1 32, and retransmits the data desig- 
nated by the data 210, using the second protocol. 
[0247] With respect to the data transmission by the 
second protocol from the target, the controller may 
always confirm the situation by a message transmis- 
sion. 

[0248] Also In the case where the target spontane- 
ously transmits data by the second protocol, when the 
controller detects incorrect data, the controller performs 
confirmation and request for retransmission as 
described above, by using a message of the first proto- 
col. 

[0249] In this way, since confirmation and request 
for retransmission with respect to data transmission by 
the second protocol are performed by the first protocol, 
the data transmission by the second protocol is per- 
formed reliably, whereby the reliability of the system is 
increased. 

[0250] Furthenrnore, also when normal transmis- 



sion cannot be performed due to errors in the controller 
or the target, these errors can be detected by checking 
the data at the transmitter end and the receiver end, 
whereby normal transmission is assured. 

5 [0251] Next, a description will be given of the struc- 
ture of a display element according to the first embodi- 
ment, with reference to the drawings. 
[0252] Figure 10(a) is a diagram illustrating the 
structure of a display element according to the present 

10 invention. 

[0253] In figure 10(a), 50 denotes a display ele- 
ment, 51 denotes ID information of the display element, 
52 denotes size information of the display element, 53 
denotes ID information of a first attribute, 54 denotes 

75 size information of the first attribute, 55 denotes first 
attribute information data, 56 denotes ID information of 
a second attribute, 57 denotes size information of the 
second attribute, and 58 denotes second attribute infor- 
mation data. « In figure 10(a), each information has 16 

20 bits in the horizontal direction, but the number of bits is 
not restricted thereto. 

[0254] The ID information of the display element 
comprises an ID number of the display element, type 
information indicating the type of the display element, 
25 and the like, and this ID information indicates what the 
display element is. 

[0255] The size information of the display element 
indicates the size of the whole attribute information of 
this display element, i.e., the size of the attribute sec- 
30 tion, and this size information is represented by t>ytes, 
for example. 

[0256] The attribute section is a section where the 
attribute of the display element is described. The 
attribute includes the size of the display element 

35 (number of pixels), positional information (number of 
pixels), and the like. When the display element is a 
panel or a group, the attribute includes the ID informa- 
tion of objects having links. These pieces of information, 
i.e., the ID information of each attribute, the size infor- 

40 mation of each attribute, and the atti-ibute information 
data of each attribute are represented in the same for- 
mat The order of these pieces of attribute information is 
arbitrary, and each attribute is distinguished from 
another attribute by its ID information. 

45 [0257] The ID information of each attribute com- 
prises an ID number of the attribute, type information 
indicating the type of the attribute, and the like, and this 
ID information indicates what the attribute is. 
[0258] The size information of each attribute indi- 

50 cates the size of the attribute infonmation data of this 
attribute, and it is represented by bytes, for example. 
[0259] In this way, the display elements, i.e., the 
panel, group, and display part, have the same data for- 
mat, and the ID information and the size information are 

55 followed by one or plural pieces of attribute information. 
Further, each attribute information has the same data 
fonnat as that of the display element. 
[0260] By making the data format uniform among 
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the respective display elements, the processing of the 
controller is simplified, whereby high-speed processing 
is achieved and debug is facilitated. 
[0261] Further, by making the data format uniform 
between each display element and each attribute infor- 5 
mation, the processing of the controller is unified, 
whereby high-speed and simple processing is achieved 
and, further, creation of processing software and data is 
facilitated. 

[0262] Next, figure 10(b) shows the structure of the io 
attribute information according to the present invention. 
[0263] First of all, the attribute size information is 
incorporated in the attribute ID information, and the size 
of the attribute information is represented by the field 
(e.g., 4 bits) of the size information. For example, when is 
"1" is written in the size infomnation field, the size of the 
attribute information means 1 word (16 bits), and when 
•2" is written, it means 2 words. Since the size informa- 
tion is written by using part of the field of the ID informa- : 
tion, the quantity of data can be reduced with respect to 20 
the attribute information having relatively small quantity 
of attribute information data. 

[0264] For example, when one piece of large-size 
attribute information exists in the function chart, the 
attribute size information 53 should be increased 25 
according to this size (e.g., 4 bytes). At this time, with 
respect to a large number of small-size attribute infor- 
mation, the data quantity of each small-size attribute 
information can be reduced by using the method shown 
in figure 10(b), whereby the memory quantity can be 30 
reduced. 

[0265] Further, when the unit of the size repre- 
sented by the size information field is increased, even 
somewhat large-size data can be represented in this 
format, whereby the attribute side information 54 can be 35 
dispensed with. 

[0266] It is not necessary to store these data with 
this data fomnat in the controller or the target so long as 
the data format at transmission is uniform. Of course, 
when these data are transmitted on the transmission 40 
line 1 , these data written in this data format are sub- 
jected to division-into-packets and addition of headers. 
[0267] Next, a description will be given of the struc- 
ture of display data according to the first embodiment, 
.with reference to the drawings. 45 
[0268] Rgure 11 is a diagram illustrating the struc- 
ture of display data according to the present invention. 
In figure 11, 60 denotes display data, 61 denotes ID 
infomnation of the display data, 62 denotes size informa- 
tion of the display data, and 63 denotes actual data. so 
[0269] The ID Infomnation of the display data com- 
prises an ID number of the display data, type informa- 
tion indicating the type of the display data, and the like, 
and this ID information indicates what the display data 
is. 55 
[0270] The size information of the display data 
shows the size of the actual data of the display data, 
and it is represented by bytes, for example. The number 
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of bits of the ID information or the size information may 
be different from that of the display element. 
[0271 ] The actual data is a section where the actual 
data of the display data is stored, and bit mapped video 
data, audio data, text data, program data, and the like 
are stored. 

[0272] Further, attribute information indicating the 
types and sizes of these bit mapped data are described 
as attribute information of the display part. Further, in 
figures 1 0 and 1 1 , the data structure is in the following 
order: ID Information size information — > ID informa- 
tion size information .... but the data structure is not 
restricted to this order. For example, it may be in the 
order as follows: size information -> ID information 
size information ... 

[0273] Next, the structure of a function chart 
according to the first embodiment will be described with 
reference to the drawings. 

[0274] Figure 12 is a diagram for explaining the 
structure of the function chart according to the present 
invention, and figure 13 shows an example of a panel 

display on the controller. 

[0275] In figure 12, one panel in the function chart 
indicates a menu of a VTR, and the panel includes, as 
attribute information, a title, a title image, unique infor- 
mation such as its background and size, and links to 
groups, i.e., ID information of the groups. Each group 
shows an aggregate of display parts according to the 
function or display. For example, there are three groups 
like contents, a deck, and a tuner. 
[0276] Each group includes, as attribute informa- 
tion, unique information such as its size, location, back- 
ground, and links to the display parts, i.e., ID 
information of the display parts. The links to the display 
parts indicate the display parts which belong to this 
group. 

[0277] Each display part is a part for displaying an 
icon, button, slider, check box, text entry, or the like, and 
the display part includes, as attribute information, 
unique information such as its size, location, state, vari- 
able, etc.. and links to display data (ID information of 
display data). However, a display part such as a slider, 
check box, or text entry has no display data, and its fea- 
ture, function, or operation is represented as a display 
part, and its display may depend on the controller. 
[0278] Each display data is data such as still-picture 
data, video data, text data, audio data, program data, or 
the like, and it shows the display data of a panel, group, 
or display part. 

[0279] Hereinafter, the panel will be described 
briefly with reference to the drawings. 
[0280] Figure 13 shows an example of a display on 
the above-described panel. Each group is not displayed 
on the screen of the controller. Of course, each group 
may be displayed on the screen together with its title 
and title image. 

[0281] Further, figure 14 shows another example of 
a panel of the controller according to the first embodi- 
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ment. 

[0282] In figure 1 4, the panel is constructed as an 
aggregate of display parts into which one bit map data 
is divided arbitrarily. Panial screen data 701, 702, 703, 
and 704 are obtained by dividing data of one bit map 
indicating this panel, and each partial screen data cor- 
responds to a display part and has ID information of the 
display part on the panel. 

[0283] When the display data (partial screen data) 
of any display part is changed due to the user operation 
or a change in the state of the target, the target notifies 
the controller of this change for each display part, 
thereby notifying the user of this change. 
[0284] While in this first embodiment data of one bit 
map showing a panel is divided into plural parts, a panel 
may be constituted by only data of one bit map showing 
the panel. In this case, although the quantity of data to 
be transmitted by the target due to the user operation or 
state change of the target is increased, the same effects 
as described above are achieved. 
[0285] While in this first embodiment the controller 
performs visual display, means for visual display may be 
provided independently from the controller and the tar- 
get, and the user may operate the controller using a 
remote controller or the like while watching the screen 
of this display means. Also in this case, the same effects 
as mentioned above are achieved. This display means 
may be included In the controller or the target, or it may 
be an independent device. 

[0286] In this case, the data transmitted by the sec- 
ond protocol may be received not by the controller but 
by the display means, and the display means may 
arrange and display the data on the screen. Alterna- 
tively, the data may be received by the controller and 
arranged by the controller according to the screen size 
or the lii^e bfthe dispfay1Yiffarfe:Mrf this case, the contrdi- 
ler creates bit map data having a size, aspect ratio, and 
the like suited to the display means, and transmits the 
bit map data to the display means by the second proto- 
col so that the display means can display the data. 

(Embodiment 2) 

[0287] Next, a description will be given of an AVC 
system utilizing a network control system having a tar- 
get the operation of which is different from that of the 
target according to the first embodiment, with reference 
to the drawings, 

[0288] Figure 15 shows an example of a system 
construction. In figure 15, 1541 denotes a TV, 1542 
denotes a remote controller of the TV, 1543 denotes a 
PC, 31 denotes a recordable and playable DVD, 32 
denotes a DV system DVC, 33 denotes a VHS system 
DVHS, 34 denotes a DV system DVC movie, 35 denotes 
a STB for SC digital broadcasting or the like. These 
devices are connected with each other by a transmis- 
sion line 1, thereby constituting an AVC system net- 
work. 



[0289] First of all, these constituents will be 
described. The same constituents as those described 
for the first embodiment are given the same numbers as 
those shown in figure 1 and, therefore, repeated 

5 description is not necessary. 

[0290] The TV 1541 is a device comprising a con- 
troller, a consumer, and a target (in this case, a ground 
wave tuner and a video monitor). An instruction is given 
to a controller internal function control means, which is 

10 described later, by using the remote controller 1542, 
and data obtained from another target is displayed on 
the screen. 

[0291] The PC 1543 is a device comprising a con- 
troller, consumer, and a target (in this case, a modem 

15 which interfaces with a telephone line, and a video mon- 
itor or the like). The user gives an instruction to the con- 
troller internal function control means by using a key 
board or a mouse, to display data obtained from another 
target on the screen. Each of the TV 1541 and the PC 

20 1543 is defined as a device in which the target, the con- 
troller, and the consumer are united. 
[0292] In this second embodiment, the DVD 31, 
DVD32. DVHS 33, DVC movie 34. and STB 35 are 
described as targets, each of these devices may include 

25 a controller and a target so long as the user can perform 
operation such as selecting a function of another target 
with a touch panel or a remote controller although the 
size of the device is small. Further, each of these 
devices may include a consumer when it realizes an 

30 environment for displaying data of another target by a 
liquid crystal panel or the like or when it has the function 
of processing data from another target. 
[0293] Further, each of the above-mentioned 
devices constituting the AVC system network may be 

35 constructed as follows. That is, the device includes 
functions as a consumer and a controller and has^'aT"^* 
remote controller, and displays only display and audio 
on a monitor by analog connection so that the user can 
control the device with the remote controller while 

40 watching the display. In this case, the device may 
include a controller and a target. 

[0294] Further, as a device including a consumer, 
there is a device for outputting data for printing or dis- 
play, such as a printer and a TV, and a device for con- 
45 verting the format of data to transmit the data to another 
device, such as a modem, a bridge, a router, and a 
gateway. 

[0295] Hereinafter, a description will be given of a 
target according to this second embodiment, which is 
50 used in the network control system so constructed, with 
reference to the drawings. 

[0296] Figure 1 6 is a block diagram illustrating a tar- 
get according to the second embodiment. In figure 16, 1 
denotes a transmission line, 2 denotes a packet trans- 
55 mission/reception means, 3 denotes a synchronous 
data transmission/reception means, 1604 denotes a tar- 
get signal processing means, 5 denotes an asynchro- 
nous data transmission/reception means, 1 606 denotes 
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a first protocol processing means, 7 denotes device 
construction information. 1618 denotes a second proto- 
col transmission means. 1620 denotes a connection 
management means, 1621 denotes a first target inter- 
nal function control means, 1 622 denotes a second tar- 5 
get internal function control means, and 1623 denotes a 
third target internal function control means. The number 
of target internal function control means may be arbi- 
trary, that is, the target may have one piece or plural 
pieces of internal function control means. Further, it is jo 
supposed that a target having no internal function con- 
trol means exists, in this second embodiment, three 
pieces of internal function control means are provided. 
Further, an internal function control means corresponds 
to a unit of function inside a target, a controller, or a con- 15 
sumer, and an internal function control means included 
in a target is called a target internal function control 
means. 

[0297] Hereinafter, the respective constituents of 
the target will be described. The same constituents as 20 
those described for the first embodiment are given the 
same numbers as those shown in figure 2 and, there- 
fore, repeated description is not necessary. 
[0298] The target signal processing means 1604 
receives synchronous data from the synchronous data 25 
transmission/reception means 3. and performs signal 
processing according to the target. For example, when 
the target is a recording/playback device such as a 
DVC, the target signal processing means 1604 subjects 
the synchronous data to signal processing as follows: 30 
format conversion for recording the data in a recording 
medium such as a magnetic tape, decoding of transmis- 
sion line code, alteration of data compression method, 
and decoding of data. Then, the processing means 
1 604 transmits the data to each of the target internal 35 
function control means according to an instruction from 
the connection management means 1620. 
[0299] Further, the target signal processing means 
1604 takes synchronous data of a recording medium or 
a broadcast wave from the first target internal function 40 
control means 1 621 , the second target internal function 
control means 1 622, and the third target internal func- 
tion control means 1623, performs fomiat conversion 
and the like, and transmits the data to the synchronous 
data transmission/reception means 3. 45 
[0300] The target signal processing means 1604 
may be constructed so that it performs only switching of 
a signal of synchronous data. In this case, the target 
signal processing means 1604 transmits the synchro- 
nous data obtained from the synchronous data trans- so 
mission/reception means, to an appropriate target 
internal function control means, according to an instruc- 
tion from the connection management means 1620. 
Then, in each target internal function control means 
1621, 1622, or 1623, this data is subjected to signal ss 
processing such as format conversion, alteration of data 
compression method, and the like. Further, the target 
signal processing means 1604 selects the data which 



has been subjected to signal processing such as format 
conversion in each target internal function control 
means, according to an instruction from the connection 
management means 1620, and outputs it as synchro- 
nous data to the synchronous data transmission/recep- 
tion means. 

[0301] The first target internal function control 
means 1621 corresponds to one function unit in the tar- 
get. When the target is a VTR. it is composed of two 
function units, i.e., a tuner and a deck. Each target inter- 
nal function control means operates according to an 
instruction from the outside of the target internal func- 
tion control means, and a part of each function realizes 
the whole. The same may be said of the second target 
internal function control means 1 622 and the third target 
internal function control means 1623. These target 
internal function control means and controller internal 
function control means included in the controller are 
called genericaify as "internal function control means". 
[0302] When the data received by the first protocol 
processing means 1 606 is a control code indicating the 
operation of a target internal function control means, the 
first protocol processing means 1606 makes the internal 
function control means indicated by this data perform 
the operation according to the control code. The same 
may be said of the second target internal function con- 
trol means 1622 and the third target internal function 
control means 1623. 

[0303] The data from the first target internal func- 
tion control means 1621 , second target Internal function 
control means 1622, and third target internal function 
control means 1623 are transmitted to the controller 
through the second protocol transmission means 1618 
and the asynchronous data transmission/reception 
means 5, according to an instruction from the connec- 
tion management means 1620. A connection may be 
created according to an arbitrary protocol in the target 
between the target internal function control means 
1621, 1622, 1623, and the second protocol transmis- 
sion means 1618. 

[0304] The connection management means 1620 
manages the connection inside the target For example, 
when the data received by the first protocol processing 
means 1 606 is a message which instructs transmission 
of the synchronous data received from the transmission 
line 1 to the first target internal function control means 
1621, the connection management means 1620 
instructs the target signal processing means 1604 to 
transmit the synchronous data received by the target 
signal processing means 1604 in the target to the first 
target internal function control means 1621, Further, 
when each target internal function control means trans- 
mits the data by the second protocol to the consumer, 
the connection management means 1620 instructs the 
second protocol transmission means 1618 to receive 
the output from the target internal function control 
means, according to the target internal function control 
means. 
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[0305] Accordingly, the connection management 
means 1620 creates a connection between the target 
signal processing means and an appropriate target 
internal function control means among the first, second, 
and third target internal function control means 1621, 
1622, and 1623, according to an instruction from the 
first protocol processing means 1 606, and then creates 
a connection between this target internal function con- 
trol means and the second protocol transmission means 
1618, according to a request from the target Internal 
function control means. 

[0306] In this way, when each target internal func- 
tion control means desires wants to output the data by 
the second protocol, the flow (connection) of data in the 
target can be automatically changed. 
[0307] Next, a description will be given of the oper- 
ation of the target in response to a request from the con- 
troller, according to the second embodiment. It is 
assumed that the controller and the consumer are 
included in the same device, and share data in the 
device. However, the controller and the consumer may 
be included in different devices. 

[0308] Initially, when the target is connected to the 
transmission line 1 or the controller is connected to the 
transmission line 1, the controller reads the device con- 
struction infomnation 7 of the target, and confirms the 
information relating to the target, such as the type of the 
device and the presence of GUI information. 
[0309] Next, the controller (initiator) creates con- 
nections of the second protocol between the target and 
the consumer. These connections will be described 
later. Then, the controller issues a data request for the 
GUI information such as a panel, display parts and the 
like, to the target, and transmits the information to the 
consumer through the connection using the second pro- 
tocol. The controller may issue a command requesting 
only a specific display part in the GUI information, and 
transmit only the display part and its ID. Thus, the con- 
troller (consumer) can display the received display part 
on the screen. 

[0310] When the target receives the control code 
and the, user operation information from the controller, 
the target performs the processing indicated by the con- 
trol code and the user operation information according 
to the situation. For example, with respect to a display 
part indicating a function of the target, when the ID infor- 
mation of this display part Is transmitted from the con- 
troller to the target together with the user operation 
information indicating "selection", the asynchronous 
data transmission/reception means 5 instructs the 
device internal function control means 9 to execute the 
function indicated by this display part. As the control 
code of the display part, the ID information of the display 
part is used, for example. 

[0311] In this way, the target just presents the GUI 
information of the device in response to a request for the 
GUI information from the controller and, therefore, the 
load on the target is reduced. Further, since it is not nec- 
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essary to define a command by a standardization group 
or the like, even a devk:e having a new function which 
cannot be supposed at present can easily use this new 
function through the transmission line 1. 

5 [031 2] In the target described above, since the syn- 
chronous data transmission/reception means 3 and the 
target signal processing means 1604 are not indispen- 
sable constituents of the present invention, these 
means may be arbitrarily constructed according to the 

10 functions of the target. In some cases, there are cases 
where these means may be dispensed with. That is, 
while in the above description synchronous data is 
received, this synchronous data may be dispensed with 
in some cases. Further, each means may be constituted 

15 by either hardware or software. The controller and the 
consumer may be included in different devices. 
[0313] Hereinafter, a controller according to this 
second embodiment will be described with reference to 
the drawings. 

20 [0314] Figure 17 is a block diagram illustrating a 
controller according to the second embodiment. In fig- 
ure 1 7, 1730 denotes a first protocol processing means, 
1710 denotes a controller signal processing means, 
1 71 9 denotes a second protocol transmission means, 

25 1725 denotes a first controller internal function control 
means, 1726 denotes a second controller internal func- 
tion control means, and 1727 denotes a third controller 
internal function control means. The number of control- 
ler internal function control means may be art)itrary, or 

30 the controller may have no Internal function control 
means. In this second embodiment, the controller pos- 
sesses three intemal function control means. While in 
this second embodiment the consumer and the control- 
ler are included in the same device, these may be 

35 included in different devk:es. 

[0315] Hereinafter, the respective constituents of 
the controller will be described in brief. In figure 17, the 
same constituents as those shown in figure 1 6 are given 
the same numbers and, therefore, repeated description 

40 is not necessary. 

[0316] The controller signal processing means 
1710 receives synchronous data from the synchronous 
data transmission/reception means 3, and performs sig- 
nal processing according to the controller. For example, 

45 when the controller is a device capable of displaying 
video, such as a video monitor, it decodes the synchro- 
nous data, e.g., an MPEG2 stream, and transmits the 
data to the controller internal function control means 
which performs display, according to an instruction from 

50 the connection management means 1 620, and then this 
controller internal function control means displays the 
data on the screen. Inversely, the controller signal 
processing means 1 710 subjects the data supplied from 
the controller internal function control means to signal 

55 processing, such as format conversion, and stream 
compression or decompression, and transmits the data 
to the synchronous data transmission means 3. 
[0317] The controller signal processing means 
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1710 may be constructed so that it performs only 
switching of a signal of synchronous data. At this time, 
the controller signal processing means 1710 transmits 
the synchronous data supplied from the synchronous 
data transmission/reception means to an appropriate $ 
controller internal function control means, according to 
an instruction of the connection management means 
1 620. Likewise, the controller signal processing means 
1 604 selects the data which has been subjected to sig- 
nal processing such as format conversion in each con- io 
troller internal function control means, according to an 
Instruction of the connection management means 1 620, 
and outputs the data as synchronous data to the syn- 
chronous data transmission/reception means. 
[0318] The first protocol processing means 1730 is is 
identical to that used in the target. In this controller, 
however, the first protocol processing means 1730 is 
connected not with the target internal function control 
means in the target described above but with the, first, 
second, and third controller internal function control 20 
means 1725, 1726, and 1727. 

[0319] The second protocol transmission means 
1 71 9 performs the processing at the consumer end, i.e., 
the receiver end. This means 1719 receives the data of 
the target internal function control means in the target, 25 
from the connection using the second protocol, through 
the asynchronous data transmission/reception means 
5, and transmits the data to the controller internal func- 
tion control means which is described later. The con- 
nection management means 1620 performs the so 
process of connecting/disconnecting the connection by 
the second protocol, through the first protocol process- 
ing means 1730 and the asynchronous data transmis- 
sion/reception means 5, according to the first protocol. 
[0320] The controller internal function control 35 
means such as the first controller internal function con- 
trol means 1725, the second controller internal function 
control means 1726, and the third controller internal 
function control means 1727 are function units for real- 
izing functions, such as various applications like appli- 40 
cation for device control and application for edition, 
display, printing, etc., and the controller (consumer) 
receives the data to these controller internal function 
control means by the second protocol. The received 
data is, for example, instruction of display or instruction 45 
of printing. For example, a controller internal function 
control means displays a display part indicating the GUI 
information of the target which has been received using 
the second protocol, on the screen of the controller, to 
inform it to the user and, further, it performs selection of so 
a target and a function by using the first protocol accord- 
ing to the user operation. Further, the controller internal 
function control means can display or play back the data 
received from the controller signal processing means 
1710 or the data received from the first protocol ss 
processing means 1 730 or the second protocol receiv- 
ing means 1 71 9. Although in this second embodiment 
the controller internal function control means are pro- 



vided, internal function control means may be included 
in the consumer. 

[0321] The operation of the controller according to 
this second embodiment will be described hereinafter. 
[0322] Initially, when the user selects a display part 
indicating a target, the controller reads the GUI informa- 
tion of this target from the target internal function control 
means (in this case, the first target internal function con- 
trol means 1621) of the target, and displays it on the 
screen. 

[0323] Next, when the user selects a display part 
Indicating a function from the GUI information, the con- 
troller issues a control code and user operation informa- 
tion corresponding to the display part obtained from the 
first target internal function control means 1621, 
through the first protocol processing means 1730 and 
the like. The controller internal function control means 
(in this case, the first controller internal function control 
means 1725) receives a response of the target to the 
control code and the user operation Information, as GUI 
information, through the second protocol receiving 
means 1719. 

[0324] Further, when the controller receives notifi- 
cation about a change of the GUI information, e.g., the 
changed GUI infomnation, from the target by the second 
protocol, the controller displays the changed device on 
the screen. Accordingly, the controller can display the 
latest GUI with respect to the state of the target at the 
present time, on the screen, to inform it to the user. 
[0325] Next, a description will be given of the 
method of connecting/disconnecting the connection 
used by the second protocol, with reference to the draw- 
ings. 

[0326] Figures 18(a)-18(c) are diagrams each illus- 
trating the method of connecting/disconnecting the con- 
nection used by the second protocol. Figure 18(a) 
shows the case where an initiator and a consumer are 
independent devices, figure 18(b) shows the case 
where an initiator is an independent device, and figure 
1 8(c) shows the case where an initiator and a consumer 
are included in a devrce where a controller exists. In 
these figures, 1840 denotes an initiator, 1841 denotes a 
controller, 1842 denotes a target, and 1843 denotes a 
consumer. 

[0327] The "connection* is a path for data transmis- 
sion, whfch is logically constituted for the data flowing 
on the transmission line 1 , and the target and the con- 
sumer may possess plural connections. In this case, 
each connection designates an address or the like for 
data transmission/reception by a logical plug number or 
port number, and each connection is distinguished from 
another connection by the plug number or port number. 
[0328] Figure 1 8(a) shows an example in the case 
where the initiator, the controller, the target, and the 
consumer are included in independent devices, respec- 
tively, and there is a connection created by the initiator 
between the target and the consumer. 
[0329] Initially, the initiator 1840 creates a connec- 
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tion of the second protocol between the controller 1 841 
and the consumer 1843. In this connection, the trans- 
mitter of the data transmitted by the second protocol is 
the target 1842. and the receiver of the data is the con- 
sumer 1843. 

[0330] The initiator 1 840 obtains, from the controller 
1 841 , information required for connection, e,g., informa- 
tion about resources of the controller such as an 
address of a connectable buffer, and tries to connect the 
target 1842 to the connection by using the information 
obtained. When the initiator 1 840 succeeds in this, the 
Initiator 1 840 tries to connect the consumer 1 843 to the 
connection. In this way, the connection is established 
between the controller 1841 and the consumer 1843. 
[0331] Likewise, when disconnecting the devices 
from the connection, the initiator 1840 disconnects the 
consumer 1843 from the connection and then discon- 
nects the target 1 842 from the connection. When the ini- 
tiator 1 840 succeeds in this, the initiator 1 840 releases 
the resources which have been reserved for connection 
by the consumer 1843. 

[0332] Accordingly, the controller 1841 is not con- 
cerned with establishment/disconnection of the connec- 
tion between the target 1 842 and the consumer 1 843. 
[0333] Rgure 18(b) shows an example in the case 
where the initiator, the controller, and the target are 
included in independent devices, respectively, and the 
consumer is included in the device where the controller 
exists. A connection created by the initiator is present 
between the target and the controller. 
[0334] In this connection, the transmitter of the data 
transmitted by the second protocol is the target 1842, 
and the receiver of the data is the controller 1 841 . 
[0335] The initiator 1 840 obtains, from the controller 
1 841 , information required for connection, e.g., informa- 
tion about resources of the controller such as an 
address of a connectable buffer, and tries to connect the 
target 1842 to the connection by using the information 
obtained. When the initiator 1840 succeeds in this, the 
initiator 1840 tries to connect the controller 1 841 to the 
connection, tn this way, the connection is established 
between the controller 1 841 and the target 1842. 
[0336] Likewise, when disconnecting the devices 
from the connection, the initiator 1840 disconnects the 
controller 1841 from the connection and then discon- 
nects the target 1 842 from the connection. When the ini- 
tiator 1840 succeeds in this, the initiator 1840 releases 
the resources which have been reserved for connection 
by the consumer 1841 . 

[0337] Next, figure 18(c) shows an example in the 
case where the controller and the target are included in 
independent devices, and the initiator and the con- 
sumer are included in the device where the controller 
exists. A connection created by the initiator is present 
between the target and the controller. 
[0338] The controller 1 841 creates a connection of 
the second protocol between the controller 1841 and 
the target 1842. In this connection, the transmitter of the 



data transmitted by the second protocol is the target 
1 842, and the receiver of the data is the controller 1 841 . 
That is, the controller doubles as the initiator shown in 
figure 18(b). The controller 1841 otrtains information 

5 required for connection of itself, e.g., information about 
resources such as an address of a connectable buffer, 
and tries to connect the target 1 842 to the connection by 
using the information obtained. When the controller 
1841 succeeds in this, the controller 1841 tries to con- 

10 nect itself to the connection. In this way, the connection 
is established between the controller 1 841 and the con- 
sumer 1 843. 

[0339] Likewise, when disconnecting the devices 
from the connection, the controller 1841 disconnects 
15 itself from the connection and then disconnects the tar- 
get 1 842 from the connection. When the controller 1 841 
succeeds in this, the controller 1841 releases the 
resources which have been reserved for connection by 
itself. 

20 [0340] Hereinafter, the method of establishing a 
connection according to this second embodiment will be 
described using the model shown in figure 18(c). How- 
ever, the method can also be realized using other mod- 
els, and the same effects will be obtained. 

25 [0341] Since the connection establishment method 
depends on the second protocol, the initiator creates a 
connection by a method suited to the second protocol. 
[0342] Rgure 19 shows the flow of data when per- 
forming data transmission by the second protocol. 

30 [0343] In figure 19, a "plug" indicates, an opening 
through which data is input and output, and this is a log- 
teal plug. For example, each plug has a plug number, 
and is distinguished from another plug by this plug 
number. A plug of the target is included in the second 

35 protocol transmission means 1618, and a plug of the 
controller is included in the second protocol reception 
means 1 71 9. 

[0344] Initially, as described with respect to figure 
1 8, the controller (initiator) establishes a connection of 

4o the second protocol between the target and the control- 
ler (consumer). At this time, the connection of the sec- 
ond protocol is created between the plug of the target 
and the plug of the controller (consumer), 
[0345] As shown in figure 19, a plug for outputting 

45 data to be transmitted by the second protocol is pro- 
vided in each target internal function control means of 
the target. When a data output request is made to a cer- 
tain target Internal function control means by the first 
protocol from the controller, the first protocol processing 

so means 1606 in the target outputs a data output com- 
mand to the target internal function control means to 
which the request is made. On receipt of the command, 
the target internal function control means prepares for 
outputting data from its plug. To be specific, the target 

55 internal function control means searches for the data to 
be output When the target internal function control 
means confirms the presence of the data, it acknowl- 
edges the receipt of the command, and instructs the 
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connection management means 1 620 to transmit the 
data which is supplied to the internal connection of the 
target, i.e., the plug of the target internal function control 
means, to the plug of the target. 
[0346] The connection management means 1620 
confirms that the connection of the second protocol is 
not used by another target internal function control 
means, and establishes a flow of data in the target 
(internal connection). 

[0347] The protocol for data transmission/reception 
inside the target is arbitrary, and it may be performed by 
controlling writing of data into an arbitrary buffer. 
[0348] Since the plug of the target is connected with 
the plug of the controller through the connection using 
the second protocol, the data supplied to the plug of the 
target is transmitted to the plug of the controller by the 
second protocol transmission means 1 61 8, according to 
the second protocol. The data supplied to the plug of the 
controller Is received by the second protocol reception 
means 1 71 9, and transmitted to an appropriate control- 
ler internal function control means according to an 
instruction of the connection management means 1620 
in the controller. 

[0349] When the target internal function control 
means ends the data transmission, the connection 
management means 1620 disconnects the internal con- 
nection of the target, according to an instruction of the 
target internal function control means. Accordingly, 
another target internal function control means can 
transmit data onto the connection between the target 
and the controller by the second protocol. 
[0350] Rgure 20 shows the flow of data transmitted 
by the second protocol in the case where the target has 
plural pieces of target internal function control means. 
[0351] Initially, as described with respect to figure 
19, the controller (initiator) establishes a connection of 
the second protocol between the target and the control- 
ler (consumer). At this time, the connection of the sec- 
ond protocol is created between the plug of the target 
and the plug of the controller (consumer). 
[0352] Further, each target internal function control 
means inside the target is provided with a plug for out- 
putting data to be transmitted by the second protocol. 
When a data output request is made to the first target 
internal function control means by the first protocol from 
the controller, the first protocol processing means 1 606 
in the target outputs a data output command to the first 
target internal function control means. In response to 
this command, the first target internal function control 
means prepares for outputting data from its plug, and 
searches for the data to be output. When the first target 
internal function control means confirms the presence 
of the data, it acknowledges the receipt of the com- 
mand. At the same time, it outputs a request for con- 
necting the internal connection of the target, to the 
connection management means 1620. 
[0353] Assuming that the data output request from 
the controller is also transmitted to the second target 
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internal function control means, the second target inter- 
nal function control means prepares for outputting data 
from its plug according to a command, and outputs a 
request for connecting the internal connection, to the 
5 connection management means 1620. 

[0354] When the first target Internal function control 
means and the second target internal function control 
means simultaneously output requests to transmit data 
onto the connection of the second protocol, to the con- 
10 nection management means 1 620, the connection man- 
agement means permits the data transmission with the 
priority which has previously been determined, and con- 
nects the internal connection. When output of data from 
the target internal function control means having the 
15 higher priority is ended, the connection management 
means disconnects this target internal function control 
means from the internal connection, and connects the 
other target internal function control means to the inter- 
nal connection to perform data transmission from, this 
20 target internal function control means. 

[0355] The higher priority is set to an internal func- 
tion control means to which rapider response is 
requested. Accordingly, like the GUI information, an 
internal function control means which can rapidly 
25 respond to the user operation is easily realized. The pri- 
ority may be dynamically changed such that the internal 
function control means which has once performed data 
transmission is given the lower priority, whereby every 
internal function control means can transmit data. Fur- 
so ther, the controller may specify this priority, whereby 
data transmission suited to the application of the con- 
troller is realized. 

[0356] The data transmitted by the second protocol 
has ID information of the target internal function control 
35 means from which the data is transmitted, and the con- 
troller can distinguish the data transmitted through the 
connection by using this information. Accordingly, the 
controller can receive and distinguish desired data with 
relatively. 

40 [0357] The priority with respect to connection/dis- 
connection of each target internal function control 
means to/from the internal connection may be managed 
by the plug. 

[0358] Figure 21 shows the flow of data transmitted 
45 by the second protocol in the case where there are plu- 
ral transmitters, 

[0359] In figure 21 , a "port" indicates a logical place 
in each plug, through which data is input and output, 
and each port is connected to another port by one-to- 

50 one correspondence. Accordingly, each plug indicates 
an opening through which the same data is input and 
output, and each port indicates a place connected to the 
opposite port. For example, each port has a port 
number, and each port is distinguished from another 

55 port by this port number. 

[0360] Initially, as described with respect to figure 
19, the controller (initiator) establishes a connection of 
the second protocol between the target and the control- 
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ler (consumer). At this time, the connection of the sec- 
ond protocol is created between the plug of the target 
and the plug of the controller (consumer). At this time, 
one port is assigned to each of the target and the con- 
troller. In figure 21 , there are plural controllers, and each 
controller establishes a connection of the second proto- 
col in this way. Each port indicates a logical opening for 
inputting and outputting data, and makes one-to-one 
con-espondence with the other port. For example it cor- 
responds to an address of a buffer for the other port. 
[0361] Further, although each target internal tunc- 
tion control means in the target is provided with a plug 
for outputting data to be transmitted by the second pro- 
tocol, since there is no necessity of specifying the desti- 
nation of the data, the plug has no port. When a data 
output request is made to the first target intemal func- 
tion control means by the first protocol from the control- 
ler, the first protocol processing means 1606 in the 
target outputs a data output command to the first target 
internal function control means. In response to this com- 
mand, the first target internal function control means 
prepares for outputting data from its plug, and searches 
for the data to be output When the first target internal 
function control means confirms the presence of the 
data, it acknowledges the receipt of the command. At 
the same time, it outputs a request for connecting the 
internal connection of the target, to the connection man- 
agement means 1620. The connection management 
means 1 620 permits data transmission according to the 
priority which has previously been detenmined, and con- 
nects the internal connection. 

[0362] Since the plug of the target is connected with 
the plug of the controller by the connection using the 
second protocol, the data supplied to the plug of the tar- 
get is transmitted to the plug of the controller by the sec- 
ond protocol transmission means 1618 using the 
second protocol. Since each plug has a port, the same 
data is transmitted to all of the effective ports. 
[0363] Accordingly, in the controller, the second 
protocol reception means 1719 receives the data trans- 
mitted through the port in the plug of the controller, and 
transmits the data to an appropriate controller internal 
function control means according to an instruction of the 
connection management means 1 620. 
[0364] When the target internal function control 
means ends the data transmission, the target internal 
function control means disconnects the internal connec- 
tion of the target. Accordingly, another target internal 
function control means can transmit data onto the con- 
nection between the target and the controller by the 
second protocol. 

[0365] In this way, the same data can be transmit- 
ted to plural controllers. 

[0366] As described above, the controller can 
obtain desired data by instructing the target to output 
the data from the corresponding target internal function 
control means. That is, in contrast with the conventional 
controller, the controller of this second embodiment 



need not establish a connection inside the target and, 
therefore, it need not have information relating to the 
construction of the target. Further, since the internal 
connection is established only when it is needed, plural 

5 target intemal function control means can share the 
connect ion between the target and the controller, 
whereby the construction of the target is simplified, and 
the resources required for the second protocol, such as 
buffers and plugs, are effectively utilized. 

10 [0367] Further, once a connection of the second 
protocol is created between the consumer and the tar- 
get, there is no necessity of establishing a new connec- 
tion even when a new internal function control means is 
generated in the consumer or the target or when new 

IS data transmission with the existing internal function con- 
trol means is required. That is, these internal function 
control means can share the existing connection to per- 
form data transmission, whereby the processing is sim- 
plified. 

20 [0368] Further, in the network control system so 
constructed, even when the same data is transmitted 
from a target internal function control means in the tar- 
get to plural controllers, the transmitted data can be 
relayed at the plug of the target. 

2S [0369] As described above, since the target internal 
function means are provided in the target, the resources 
of the target such as plugs and buffers are effectively 
utilized, resulting in simplified structure of the target. 
[0370] Next, a description will be given of the oper- 

3o ation of the controller and the target in the network con- 
trol system according to the second embodiment 
[0371] Figure 22 is a diagram for explaining data 
transmission and reception between the controller and 
the target in the network control system according to the 

35 second embodiment In the following description, no ini- 
tiator is provided, i.e., the controller doubles as an initia- 
tor. Although transmission of GUI information will be 
described as an example, data to be transmitted is not 
restricted to the GUI information. When the target or the 

40 controller is a digital still camera, data to be transmitted 
is still-picture data, and when the target or the controller 
is a printer, it is print data. Further, it may be arbitrary file 
data, such as video data, audio data, program data, or 
data base information. Initially, when a target is con- 

45 nected to the transmission line 1 , the controller existing 
on this transmission line 1 recognizes this new target by 
a bus reset signal or the like, and reads information 
about the target written in the device construction infor- 
mation 7. from the target, through the transmission line 

so 1 , and recognizes what the target is and what kind of 
protocol the target supports. When the target supports 
the first protocol, the controller inquires of the target 
about the internal function control means possessed by 
the target with the first protocol, and detects the first 

55 target internal function control means 1621 (it may be 
the second target internal function control means 1 622 
or the third target internal control means 1 623) which 
Supports the GUI Information. In the target, these proc- 
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esses are performed by the first protocol processing 
means 1 606. In the controller, these processes are per- 
formed by the first protocol processing means 1 606 and 
the internal function control means. Further, these proc- 
esses may be performed by the controller internal func- 5 
tion control means. 

[0372] When the first controller internal function 
control means 1725 which is one of applications In the 
controller (it may be the second controller internal func- 
tion control means 1 726 or the third controller internal 10 
function control means 1727) displays the GUI informa- 
tion of the target, initially the controller reverses the 
resources in the controller which are required for the 
second protocol, and makes a message transmission 
2101 shown in figure 22, i.e.. a request for connection, is 
to the target by the first protocol. Then, the target 
checks whether it is possible to connect itself to the con- 
nection of the second protocol, and when it is possible, 
the target connects itself to the connection of the sec- • 
ond protocol. When the controller confirms, by a mes- 20 
sage response 2111, that the target acknowledges the 
request, the controller connects itself to the second pro- 
tocol, whereby the connection of the second protocol is 
established. 

[0373] Next, when the first controller internal func- 25 
tion control means 1 725 requires the GUI infonnation of 
the target, the first controller internal function control 
means 1725 transmits a request for data transmission, 
by a message transmission 2102, to the first target 
internal function control means 1621. This message 30 
transmission 21 02 may include information about a noti- 
fication range that indicates a range within which the 
controller desires to match its infonnation with that of 
the target. When the first target internal function control 
means 1 621 acknowledges, the target returns a primary 35 
response 2112 as a response to the transmission. 
Then, the first target internal function control means 
1 621 transmits the request for data transmission by the 
second protocol to the connection management means 
1620, and the connection management means 1620 40 
transmits the data output from the first target internal 
function control means 1621, to the controller through 
the connection of the second protocol. 
[0374] The message response 2112 may includes 
version information or the like according to the notifica- 45 
tion range. 

[0375] In this way, the controller obtains the data of 
the GUI information, and displays it on the screen. 
[0376] When the user selects the display part indi- 
cating the playback function of the target by using the so 
pointing function of the remote controller such as a 
crosshairs key showing up. down, left, and right, the first 
controller internal function control means 1725 trans- 
mits the ID information of the display part assigned by 
the target, as a control code, to the target, together with 55 
the user operation information, i.e., "selection". That is, 
the controller transmits the ID information of the display 
part (control code) and the user operation information 



("selection"), as a message transmission 2103, to the 
first target internal function control means 1621 of the 
target. The controller can transmit more precise user 
operation information to the target, and it is supposed 
that the controller may make another request for data. 
[0377] The user operation information may be 
encoded and transmitted together with the ID informa- 
tion of the display part, or each user operation informa- 
tion may be transmitted as one command (the operand 
is the control code such as the ID information of the dis- 
play part). 

[0378] Next, as a response to the operation 
request, the target returns a message response 2113 
indicating that the transmitted message 2103 is 
received by the target, or rejected, or is not supported. 
[0379] Next, when the state inside the target is 
changed and thereby the display part of the GUI infor- 
mation in the target is changed, the first target internal 
function control means 1621 in the target spontane- 
ously transmits the changed data (display part) by using 
the second protocol to the controller. That is, when the 
data inside the first target internal function control 
means 1 621 is changed, the first target internal function 
control means 1621 transmits a request for data trans- 
mission by the second protocol to the connection man- 
agement means 1620. Accordingly, the connection 
management means 1620 outputs the data outputted 
from the first target internal function control means 
1 621 , to the plug of the target, and the second protocol 
transmission means 1618 transmits it onto the connec- 
tion by the second protocol. 

[0380] Further, when the controller designates a 
menu unit as a notification range in the case where the 
infonnation is changed in the target and the menu to be 
displayed is changed by the user operation or the like, 
the target transmits a new menu to the controller and 
notifies the controller of changed information only when 
the infonnation in the new menu is changed. This is not 
restricted to the menu, and is also applicable to each 
display part. 

[0381] Then, the controller internal function control 
means writes the data of the changed display part in the 
corresponding part to update it, and the controller inter- 
nal function control means displays the updated func- 
tion chart. 

[0382] When the controller ends the display of the 
device of the target, the controller disconnects itself 
from the connection of the second protocol, and makes 
a message transmission 21 04 (request for disconnec- 
tion) to the target by the first protocol. 
[0383] The target checks whether disconnection of 
itself from the connection of the second protocol is 
proper or not. When it is proper, the target disconnects 
itself from the connection. 

[0384] After the controller confirms that the target 
acknowledges the request by a message response 
2114, the controller releases the resources in the con- 
troller required for the second protocol, which have 
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been reserved by itself. 

[0385] In the above-description, the connection is 
established when the controller displays the information 
of the target on the screen. However, the connection of 
the second protocol may always be established while 
power is on the target, or the connection of the second 
protocol may be created every time the controller 
requests the GUI information. Alternatively, the initiator 
may create the connection of the second protocol 
according to a request from the controller internal func- 
tion control means. The same may be said of discon- 
nection of the devices from the connection. 
[0386] Further, with respect to the internal connec- 
tion of the target, the target intemal function control 
means or the plug in the target may create the connec- 
tion. The same may be said of disconnection of the 
internal connection. 

[0387] The order of the response message 2112 
and the data transmission 2201 by the second protocol 
is arbitrary, and the response message 2112 may be 
retumed after the data transmission 2201 has started. 
That is, a message indicating a data request only 
instructs data output, and it is not necessary to assure 
data transmission. When data transmission is assured, 
the controller receiving this data (or the controller inter- 
nal function control means) decides whether the 
requested data has been received correctly, and when 
the requested data has not been received correctly, the 
controller makes a second data sequent, or the control- 
ler inquires about the state in the target (or target inter- 
nal function control means) by the first protocol and 
checks the connection, and then makes a second 
request according to the situation. In this way, the net- 
work control system can deal with unexpected en-ors, 
whereby the data are transmitted with high reliability. 
[0388] When the controller and the consumer are 
included in different devices, the controller transmits a 
message (reception request) also to the consumer by 
the first protocol. Accordingly, when the consumer has 
received the data correctly, it returns a response mes- 
sage indicating "completion" to the controller. When 
errors occur during data reception, the consumer 
returns a message indicating "error* to the controller. 
Thereby, the controller confirms whether the data has 
been correctly transmitted or not» and inquires about the 
state of the target and checks the connection if neces- 
sary. Then, according to the situation, the controller out- 
puts a request for retransmission to the target, and a 
second reception request to the consumer. As 
described above, since error check is performed 
according to whether the consumer has received the 
data correctly or not, errors are detected with reliability, 
and error recovery is executed by the simple method. 
[0389] While in the above description the GUI infor- 
mation is transmitted by the second protocol, arbitrary 
data may be transmitted or received by the second pro- 
tocol, for example, still-pk:ture file data, bit map of part 
or all of the screen, text data, OSO (On Screen Data), 



and audio file data. Further, while in the above descrip- 
tion the controller displays the data received by the sec- 
ond protocol on the screen, the controller may print or 
process the received data, with the same effects as 
5 mentioned above. 

[0390] Next, the controller's transmission/reception 
operation will be described with reference to the draw- 
ings. The description about error handling during com- 
munication is omitted. 

10 [0391] Figures 23(a) and 23(b) are flowcharts each 
illustrating the operation flow of the controller. To be 
specific, figure 23(a) shows the operation relating to the 
first protocol, and figure 23(b) shows the operation relat- 
ing to the second protocol. The flows shown in figure 

15 23(a) and 23(b) are executed in parallel with each other 
on the controller 

[0392] With reference to figure 23(a). in step 2501. 
the controller establishes a connection for the second 
protocol to the target according to a request inside the 

20 controller such as the user's pushing a menu button of 
the remote controller. Then, in step 2502, in order to dis- 
play the GUI of the target according to the user opera- 
tion, the controller transmits a message of a request for 
data to the target. The controller waits for a response to 

25 this data request in step 2503. When the controller 
receives an acknowledgement from the target, it detects 
the user operation in step 2504. 

[0393] In the case where the user performs an 
operation on the operation screen of the controller and 
30 then the controller notifies of the target about this oper- 
ation, the controller transmits the ID information of the 
object and the user operation information to the target in 
step 2502. 

[0394] On the other hand, when there is no user 
35 operation, the controller decides whether this operation 
flow should be ended or not in step 2505. When the 
controller decides that there is no necessity of display- 
ing the GUI information of the target according to the 
user operation or the like, the controller disconnects the 
4o connection of the second protocol in step 2506. On the 
other hand, when the controller continues to display the 
GUI information of the target, the controller checks the 
user operation to be transmitted to the target In step 
2504. Step 2504 is merely an example, and this step is 
45 not necessarily perfonmed, that is, this step may be dis- 
pensed with, 

[0395] The operation flow shown in figure 23(b) is 
started after the controller has established the connec- 
tion in step 2501 shown in figure 23(a). Initially, the con- 

50 troller checks reception of data by the second protocol 
in step 2510. When the controller receives data, it 
updates the display in step 2514. 
[0396] After updating the display in step 2514 or 
when receiving no data in step 2510, the controller 

55 decides whether this operation flow should be ended or 
not in step 2515. When the controller decides that there 
Is no necessity of displaying the GUI information of the 
target according to the user operation, the controller 
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ends this operation flow. On the other hand, when the 
controller continues to display the GUI information of 
the target, it waits for data reception In step 2510. The 
END decisions in steps 2510 and 2515 may be per- 
formed at the same time. 5 
[0397] Next, the target's transmission/reception 
operation will be described with reference to the draw- 
ings. The description about error handling during com- 
munication is omitted. 

[0398] Rgure 24 is a flowchart showing the opera- io 
tion flow of the target Initially, the target waits for the 
controller's establishing the connection of the second 
protocol, in step 2610. After the connection has been 
established, the target checks whether there is a mes- 
sage from the controller in step 2602. When there is no is 
message, the target checks its internal state in step 
2603. When the state is not changed, the target decides 
whether the operation flow should be ended or not in 
step 261 1 . When the target is disconnected from the 
connection by the controller or when the target receives 20 
an END message from the controller, the target ends 
this operation flow. On the other hand, when the target 
continues the operation, the control returns to step 
2602. 

[0399] When there is a message in step 2602, the 25 
target decides the purpose of this message, and checks 
the state of the target and whether the target supports 
this function, and then transmits a response to the mes- 
sage to the controller according to the practicability of 
this message, in steps 2604 and 2609. so 
[0400] When the received message is a data 
request, the target decides the practicability of this 
request In step 2605. When it is practicable, the target 
sends an acknowledgement to the controller, and cre- 
ates data (function chart) or prepares the existing data 35 
(function chart) when it is available, in step 2606. Then, 
the target establishes the internal connection between 
the target Internal function control means and the plug 
of the target In step 2620, and transmits the data (func- 
tion chart) to the controller in step 2608. After transmis- 40 
sion, the target disconnects the internal connection 
between the target internal function control means and 
the plug of the target in step 2621. On the other hand, 
when the request is not practicable, the target sends a 
message such as "execution rejected" to the controller. 45 
[0401] Likewise, when the internal state of the tar- 
get Is changed In step 2603, the target updates the data 
(function chart) in step 2607, establishes the internal 
connection between the target Internal function control 
means and the plug of the target in step 2620, and 50 
transmits the data (function chart) to the controller in 
step 2608. After transmission, the target disconnects 
the internal connection between the target internal func- 
tion control means and the plug of the target in step 

2621. 55 
[0402] When the received message is not a data 
request but ID information of a display part and user 
operation information, the target performs processing 
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according to each message in step 2609. To be specific, 
the target decides the practicability of the message in 
step 2609. When it is practicable, the target transmits an 
acknowledgement to the controller, and performs 
processing corresponding to this message in step 261 0. 
On the other hand, when It is not practicable, the target 
sends a message such as "execution rejected " to the 
controller. 

[0403] While in the above description END decision 
is made in step 261 1, when the target receives a mes- 
sage about disconnection or a message about end of 
GUI display from the controller, it may be made in step 
2610 to end the operation flow. 

[0404] While the function chart possessed by the 
target is described as data to be transmitted, data pos- 
sessed by the target is not restricted thereto. 
[0405] As described above, since data are transmit- 
ted using plural protocols, an appropriate protocol can 
be used for mass data such asjcons. whereby rapid and - 
efficient data transmission is realized. Further, the con- 
nection management means and the internal function 
control means are provided in the target, and the con- 
nection management means establishes the internal 
connection between the output of the internal function 
control means and the connection of the second proto- 
col according to a request from the internal function 
control means. Therefore, even when plural pieces of 
internal function control means exist In the target as well 
as when a single internal function control means exists 
in the target, the initiator need not create the internal 
connection of the target, and the target can freely estab- 
lish the internal connection, whereby the target can 
switch the internal connection according to the respon- 
sibility of each internal function control means for data 
transmission, with the result that the target can be 
designed with desired performance. 
[0406] Further, an arbitrary number of Internal con- 
nections of the target can be established as needed, 
and plural internal function control means can share 
one connection of second protocol, whereby the 
resources required for the second protocol such as buff- 
ers and plugs are effectively utilized, resulting in simpli- 
fied construction of the target. Further, since the 
processing Inside the target is simplified, the load on the 
target is reduced. Further, the consumer and the con- 
troller need not have information relating to the con- 
struction of the target, and only one connection Is 
needed even when controlling the target having plural 
internal function control means, whereby the construc- 
tion and processing of the. controller are simplified. Fur- 
thermore, this target can deal with a new function of a 
device which will appear in future, and the consumer 
and the controller can support this target. 
[0407] Furthermore, since the controller doubles as 
the consumer, the controller and the consumer can 
share means and data, whereby association between a 
message and data which are closely related with each 
other is facilitated. Therefore, memories such as buffers 
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and the processing are simplified, resulting In a network 
control system having a simpler construction. 
[0408] Furthermore, since the controller transmits a 
message by the first protocol to a plug which Indicates a 
data input/output port of the internal function control s 
means of the target and then the target operates 
according to this message, the relation between the 
connection of the second protocol and the message is 
made dear and, moreover, the data flowing on the con- 
nection of the second protocol is associated with the 10 
message. Since the message is transmitted to the plug, 
the target can select a controller which handles the 
transmitted data by using this plug, or permit only con- 
trol from a specific controller, or restrict a controller 
which can control the target. Further, the target may be 15 
constructed so that connection or disconnection of the 
internal connection of the target is performed by a plug. 
Since the controller itself need not establish the internal 
connection of the target, a networlc control system hav- 
ing a simplified construction is realized. 20 
[0409] Furthemnore, since the controller doubles 
the consumer, the controller and the consumer can 
share means and data, whereby memories such as 
buffers and the processing can be simplified. Further, 
since the target executes the process specified by the 25 
message supplied to the plug of the connection of the 
second protocol, the relation between the instruction 
from the controller and the output data is made dear, 
and exclusive control is realized. Thereby, error han- 
dling in the case where data has not been received is 30 
simplified, resulting in a network control system having 
a simpler construction. 

[0410] Especially when plural pieces of internal 
function control means exist in the target, these internal 
function control means output data to different plugs, 35 
and receive messages directed to the respective inter- 
nal function control means by the respective plugs, 
whereby a target having internal function control means 
capable of completely synchronous operation is easily 
constructed. 40 
[0411] Furthermore, in the case where an internal 
function control means is controlled by plural control- 
lers, each internal function control means may be man- 
aged so that it is controlled by an arbitrary number of 
controllers, according to resources or the like of the 45 
internal function control means, whereby exclusive con- 
trol is easily realized. 

[041 2] While in this second embodiment the plug of 
each target internal function control means is described 
as an output plug, it may be an input plug. To be spe- so 
cific, when the target internal function control means 
receives a message from the controller which indicates 
an instruction of reception, initially the connection man- 
agement means 1620 establishes an internal connec- 
tion between the plug of the target and the input plug of 55 
the target internal function control means according to a 
request from the first target internal function control 
means 1621. Then, the plug of the target receives data 
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from the connection of the second protocol, and this 
data is transmitted from the plug of the target to the 
input plug of the target internal function control means. 
Also in this case, the same effects as mentioned above 
are achieved. 

[0413] Likewise, the controller may be constructed 
so that the controller internal function control means 
has an output plug, with the same effects as mentioned 
above. 

APPLICABILITY IN INDUSTORY 

[0414] As described above, in the network control 
system according to the present invention, mass data 
such as icon data can be transmitted efficiently, speed- 
ily, and reliably, with a relatively simple construction. 
Further, even when the target spontaneously transmit 
data, the controller can easily decide what the target 
has transmitted. Furthermore, the controller, target, and 
consumer for the network control system are very useful 
in constituting the above-described network control sys- 
tem. 
f 

Claims 

1. A network control system for transmitting data 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at 
least one kind of data among video data, audio 
data, and information data, are connected through 
a transmission line, wherein: 

each of the devices includes either or both of; 

at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
sage and performs processing according 
to the message: 

said network control system comprises, at 
least, said controller, said target, and an initia- 
tor for establishing a connection for data trans- 
mission between said controller and said 
target; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection established by the ini- 
tiator; and 

said target transmits data onto the connection 
by the second protocol according to the mes- 
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sage received by the first protocol. 

2. A network control system for transnnitting data 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at s 
least one kind of data annong video data, audio 
data, and information data, are connected through 

a transmission line, wherein: 

each of the devices includes either or both of; io 

at least one controller which transmits a 
message, and 

at least one target which receives the mes> 
sage and performs processing according is 
to the message; 

said network control system comprises, at 
least, said controller, said target, and an Initia- 
tor for establishing a connection for data trans- 20 
mission between said controller and said 
target; 

said plural protocols comprise; 

a first protocol which comprises message 25 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 30 
onto the connection; 

said initiator establishes, before data transmis- 
sion, a connection of the second protocol 
between the controller and the target; 35 
when the controller receives the data from the 
target, said controller makes a data request by 
the first protocol; 

said target transmits the data onto the connec- 
tion by the second protocol according to the 40 
data request; and 

said controller receives the data by the second 
protocol. 

3. A network control system for transmitting data 45 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at 
least one kind of data among video data, audio 
data, and information data, are connected through 

a transmission line, wherein: so 

each of the devices includes either or both of; 

at least one target which receives a mes- 
sage and performs processing according .55 
to the message, and 

at least one controller which transmits the 
message and establishes a connection for 



data transmission with the target; 

said network control system comprises, at 
least, said controller and said target; 
said plural protocols comprise; - 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 

said controller establishes, before data trans- 
mission, a connection of the second protocol to 
the target; 

when the controller receives the data from the 
target, said controller makes a data request by 
the first protocol; 

said target transmits the data onto the connec- 
tion by the second protocol according to the 
data request; and 

said controller receives the data by the second 
protocol. 

4. A network control system for transmitting data 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at 
least one kind of data among video data, audio 
data, and information data, are connected through 
a transmission line, wherein: 

each of the devk:es includes either or both of; 

at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
sage and performs processing according 
to the message; 

said network control system comprises, at 
least, said controller, said target, and an initia- 
tor for establishing a connection for data trans- 
mission between said controller and said 
target; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 

said initiator establishes, before data transmis- 
sion, a connection by the second protocol 
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between the controller and the target; 
the target spontaneously transmits data to the 
controller through the connection by the sec- 
ond protocol; and 

said controller receives the data by the second 5 
protocol. 

5. A network control system for transmitting data 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at io 
least one kind of data among video data, audio 
data, and information data, are connected through 

a transmission line, wherein: 

each of the devices includes either or both of; is 

at least one target which receives a mes- 
sage and performs processing according 
to the message, and 

at least one controller which transmits the 20 
message and establishes a connection for 
data transmission with the target; 

said network control system comprises, at 
least, said controller and said target; 2S 
said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 30 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 

35 

said controller establishes, before data trans- 
mission, a connection of the second protocol to 
the target; 

the target spontaneously transmits data to the 
controller through the connection by the sec- 4o 
ond protocol; and 

said controller receives the data by the second 
protocol. 

6. A network control system for transmitting data 45 
between devices by using plural protocols, in a net- 
work In which at least two devices for handling at 
least one kind of data among video data, audio 
data, and information data, are connected through 

a transmission line, wherein: so 

each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 55 
transmits a message, 
at least one target whk:h performs 
processing according to the message and 



includes at least one intemal function con- 
trol means, 

a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said network control system comprises, at 
least, said controller, said target, said con- 
sumer, and said initiator; 
said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

when said internal function control means per- 
forms said data transmission, a connection 
management means in the target connects the 
output of the internal function control means to 
the connection of the second protocol, accord- 
ing to a request of the internal function control 
means. 

7. A network control system for transmitting data 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at 
least one kind of data among video data, audio 
data, and information data, are connected through 
a transmission line, wherein: 

each of the devices comprises at least one pf 
the following units; 

at least one controller which receives and 
transmits a message, 
at least one target which performs 
processing according to the message and 
includes at least one intemal function con- 
trol means, 

a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said network control system comprises, at 
least, said controller, said target, said con- 
sumer, and said initiator; 
said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
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and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and s 

said target transmits data including an identifier 
which specifies the output source of the data, 
onto the connection, according to the second 
protocol. 10 

8. A network control system for transmitting data 
between devices by using plural protocols, in a net- 
work in which at least two devices for handling at 
least one kind of data among video data, audio is 
data, and information data, are connected through 

a transmission line, wherein: 

each of the devices comprises at least one of 
the following units; 20 

at least one controller which receives and 
transmits a message, 
a target which performs processing 
according to the message, 25 
a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 30 

said network control system comprises, at 
least, said controller, said target, said con- 
sumer, and said initiator; 

said plural protocols comprise a first protocol 35 
which comprises message transmission for 
transmitting the message and message 
response which is a response to the message 
transmission, and a second protocol for data 
transmission onto the connection; 40 
said controller transmits an identifier indicating 
the destination in the consumer, to the target, 
using the first protocol; and 
said target transmits the data including the 
identifier which indicates the destination and is 45 
received by the first protocol, onto the connec- 
tion, using the second protocol. 

9. A network control system for transmitting data 
between devices by using plural protocols, in a net- so 
work in which at least two devrces for handling at 
least one kind of data among video data, audio 
data, and information data, are connected through 

a transmission line, wherein: 

55 

each of the devices comprises at least one of 
the following units; 



at least one controller which receives and 
transmits a message, 

at least one target which performs 
processing according to the message and 
includes at least one internal function con- 
trol means, 

a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said network control system comprises, at 
least, said controller, said target, said con- 
sumer, and said initiator; 
said plural protocols comprise; 

a first protocol which comprises message 
— transmission for transmitting the message « 

and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 

said controller transmits the message by the 
first protocol to a plug through which data is 
input and output to/from a desired internal 
function control means; and 
said target executes the process specified by 
the message directed to the plug, 

10. A network control system as described in any of 
Claims 1 to 9, wherein said message includes a 
message for confirming the data transmission by 
the second protocol. 

11. A network control system as described in any of 
Claims 1 to 9, wherein the data transmitted by the 
second protocol includes version information, and 
the version of the data is managed by using the ver- 
sion information. 

12. A network control system as described in any of 
Claims 1 to 9. wherein the data transmitted by the 
second protocol is information about a graphical 
user interface which forces the controller to make a 
notification to the user. 

13. A network control system as described in any of 
Claims 1 to 9, wherein the data transmitted by the 
second protocol includes attribute information of 
the data. 

14. A network control system as described in Claim 13 
wherein the attribute information includes an identi- 
fier, size information, and a data section. 
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15. A network control system as described in any of 

Claims 1 to 9, wherein the data transmitted by the 
second protocol is based on an object as a unit. 

16. A network control system as described in Claim 15, 
wherein said object has the same structure as 
attribute infomiation of the data transmitted by the 
second protocol. 

17. A network control system as described in Claim 15, 
wherein said object has an identifier, size informa- 
tion, and a data section. 

18. A network control system as described In Claim 15, 
wherein said object has attribute information in the 
data section. 

19. A controller used in a network control system for 
transmitting data between devtees by using plural 
protocols, in a network in which at least two devices 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 



each of the devices includes either or both of; 25 



at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
sage and perfomns processing according 
to the message; 



20. 



said network control system comprises, at 

least, said controller and said target; 

a connection for data transmission between the 

controller and the target is established by an 

initiator or the controller; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said controller supports the plural protocols, 
transmits the message by the first protocol, and 
receives the data from the connection by the 
second protocol. 

A controller used in a network control system for 
transmitting data between devices by using plural 
protocols, in a network in which at least two devices 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 
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each of the devtees includes either or both of; 

at least one controller which transmits a 
message, and 

at least one target whrch receives the mes- 
sage and performs processing according 
to the message; 

said network control system comprises, at 

least, said controller and said target; 

a connection for data transmission between the 

controller and the target is established by an 

initiator or the controller; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said controller supports the plural protocols, 
makes a data request by the first protocol, and 
receives the data transmitted according to the 
data request, from the connection, t>y the sec- 
ond protocol. 

21. A controller used in a network control system for 
transmitting data between devices by using plural 
protocols, in a network in which at least two devices 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices includes either or both of; 

at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
sage and performs processing according 
to the message; 

said network control system comprises, at 

least, said controller and said target; 

a connection for data transmission between the 

controller and the target is established by an 

initiator or the controller; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 
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said controller supports the plural protocols, 
establishes the connection to the target in 
advance, makes a data request by the first pro- 
tocol when receiving data, and receives the 
data transmitted according to the data request, 5 
from the connection, by the second protocol. 

22. A controller used in a network control system for 
transmitting data between devices by using plural 
protocols, in a network in whfeh at least two devices 10 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices includes either or both of; is 

at least one controller which transmits a 
message, and 
- - at least one target which receives the mes- 
sage and performs processing according 20 
to the message; 

said network control system comprises, at 
least, said controller and said target; 
a connection for data transmission between the 25 
controller and the target is established by an 
initiator or the controller; 
said plural protocols comprise; 

a first protocol which comprises message 30 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 35 
onto the connection; and 

said controller supports the plural protocols, 
and receives the data which is transmitted onto 
the connection spontaneously by the target 40 
according to the second protocol. 

23. A controller used in a network control system for 
transniitting data between devices by using plural 
protocols, in a network in which at least two devices 45 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices includes either or both of; so 



least, said controller and said target; 

a connection for data transmission between the 

controller and the target is established by an 

initiator or the controller; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said controller supports the plural protocols, 
establishes the connection of the second proto- 
col to the target in advance of data transmis- 
sion, and receives the data which is transmitted 
onto the connection spontaneously by the tar- 
get according to the second protocol. 

24. A controller used in a network control system for 
transmitting data between devices by using plural 
protocols, in a network in which at least two devices 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 

transmits a message, 

a target which performs processing 

according to the message, 

a consumer which receives data from the 

target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 



20 



2S 



30 



35 



40 



45 



at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
sage and performs processing according 
to the message; 

said network control system comprises, at 



said network control system comprises, at 
least, said target which transmits data including 
an identifier indicating the destination and 
55 received by the first protocol, onto the connec- 

tion, according to the second protocol, said 
controller, said consumer, and said initiator; 
and 
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said controller transmits the identifier indicating 
the destination in the consumer, to the target, 
using the first protocol. 

25. A controller used in a network control system for 5 
transmitting data between devices by using plural 
protocols, in a network in which at least two devices 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: w 

each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 75 
transmits a message, 
at least one target which performs 
processing according to the message and 
includes at least one internal function con- 
trol means, 20 
a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 25 

said plural protocols comprise; 

a first protocol whk:h comprises message 
transmission for transmitting the message so 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 35 

said network control system comprises, at 
least, said target which executes the process 
specified by the message directed to a plug 
through which data is input and output to/from 40 
a desired internal function control means, said 
controller, said consumer, and said initiator; 
and 

said controller transmits the message to the 
plug using the first protocol. 45 

26. A target used In a network control system for trans- 
mitting data between devrces by using plural proto- 
cols, in a network in which at least two devices for 
handling at least one kind of data among video so 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 



sage and performs processing according 
to the message; 

said network control system comprises, at 

least, said controller and said target; 

a connection for data transmission between the 

controller and the target is established by an 

initiator or the controllen 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said target supports the plural protocols, and 
transmits the data onto the connection k>y the 
second protocol according to the message 
received by the first protocol. 

27. A target used in a network control system for trans- 
mitting data between devices by using plural proto- 
cols, in a network in which at least two devices for 
handling at least one kind of data among video 
data, audio data, and infonmation data, are con- 
nected through a transmission line, wherein: 

each of the devices includes either or both of; 

at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
sage and performs processing according 
to the message; 

said network control system comprises, at 

least, said controller and said target; 

a connection for data transmission between the 

controller and the target is established by an 

initiator or the controller; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said target supports the plural protocols, and 
transmits the data onto the connection by the 
second protocol, according to a data request 
from the controller by the first protocol. 



each of the devices includes either or both of; 

at least one controller which transmits a 
message, and 

at least one target which receives the mes- 
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28. A target used in a network control system for trans- 
mitting data between devices by using plural proto- 
cols, in a networlc in which at least two devices for 
handling at least one kind of data among video 
data, audio data, and information data, are con- 5 
nected through a transmission line, wherein: 

each of the devices includes either or both of; 

at least one controller which transmits a 10 
message, and 

at least one target which receives the mes- 
sage and performs processing according 
to the message; 

15 

said network control system comprises, at 
least, said controller and said target; 
a connection for data transmission between the 
controller and the target is established by an 
initiator or the controller; 20 
said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 25 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

30 

said target has the plural protocols, and spon- 
taneously transmits the data onto the connec- 
tion by the second protocol. 

29. A target used in a network control system for trans- 35 
mitting data between devices by using plural proto- 
cols, in a network in which at least two devices for 
handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 40 

each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 45 
transmits a message, 
at least one target which performs 
processing according to the message and 
includes at least one internal function con- 
trol means, so 
a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 55 

said network control system comprises, at 
least, said controller, said target, said con- 



sumer, and said initiator; 
said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response whk:h is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

in said target, when the internal function control 
means performs the data transmission, a con- 
nection management means in the target con- 
nects the output of the internal function control 
means to the connection of the second proto- 
col, according to a request from the internal 
function control means. 

30. A target used in a network control system for trans- 
mitting data between devices by using plural proto- 
cols, in a network in which at least two devices for 
handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 
transmits a message, 
at least one target which performs 
processing according to the message and 
includes at least one internal function con- 
trol means, 

a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said network control system comprises, at 
least, said controller, said target, said con- 
sumer, and said initiator; 
said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response whk:h is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said target transmits data including an identifier 
which specifies the output source of the data, 
onto the connection, by the second protocol. 
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31 . A target used In a network control system for trans- 
nnitting data between devices by using plural proto- 
cols, in a network in which at least two devices for 
handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 
transmits a message, 

a target which performs processing 
according to the message, 
a consumer which receives data from the 
target, and 

an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 

said network control system comprises, at 
least, said controller which transrhits an identi- 
fier indicating the destination in the consumer 
by the first protocol to the target, said target, 
said consumer, and said initiator; and 
said target transmits the data which includes 
the identifier indicating the destination and is 
received by the first protocol, onto the connec- 
tion, by the second protocol. 

32. A target used in a network control system for trans- 
mitting data between devices by using plural proto- 
cols, in a network in which at least two devices for 
handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 
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an initiator which establishes a connection 
for data transmission between the target 
and the consumer; 

said plural protocols comprise; 

a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; 

said network control system comprises, at 
least, said controller whfch transmits the mes- 
sage by the first protocol to a plug through 
which data is input and output to/from a desired 
intemal function control means, said target, 
said consumer, and said initiator; and 
said target executes the process specified by 
the message directed to the plug. 

33. A consumer used in a network control system for 
transmitting data between devices by using plural 
protocols, in a network in which at least two devices 
for handling at least one kind of data among video 
data, audio data, and information data, are con- 
nected through a transmission line, wherein: 

each of the devices comprises at least one of 
the following units; 

said consumer, 

at least one controller which receives and 

transmits a message, 

a target which performs processing 

according to the message, and 

an initiator which establishes a connection 

for data transmission between the target 

and the consumer; 

said network control system comprises, at 
least, said controller, said target, said con- 
sumer, and said initiator; 
said plural protocols comprise; 



each of the devices comprises at least one of 
the following units; 

at least one controller which receives and 
transmits a message, 

at least one target which performs 
processing according to the message and 
includes at least one internal function con- 
trol means, 

a consumer which receives data from the 
target, and 
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a first protocol which comprises message 
transmission for transmitting the message 
and message response which is a 
response to the message transmission, 
and 

a second protocol for data transmission 
onto the connection; and 

said consumer receives data including an iden- 
tifier indicating the destination in the consumer, 
which data is transmitted by the target onto the 
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connection by the second protocol and 
received from the controller by the first proto- 
col. 
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